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ABSTRACT 

The Appalachian Education Satellite Project (AESP) 
was conceptualized in 1973 (1) to develop courses in reading and 
career-education instruction for teachers in the Appalachian region, 
and (2) to deteraine the feasibility of conducting such courses over 
a large geographical area via coaaunicatlon satellites. During the 
suaaer of 1974 nearly 600 teachers at 15 sites received graduate 
edacation courses. The evaluation of those courses Is described In 
this docuaent. Included in th€ evaluation strategies used are: (1) 
pre-post course testing of the cognitive and affective behaviors of 
participants; (2) achieveaent testing after each cnlt of instruction; 
<3) user rating of the different presentation aodes; (4) descriptive 
docaaentition of equlpaent, facilities r personnel, and participants; 
and (5) a field study of the additive iapact of three activities in 
the course learning sequence. The iapleaentatlon and data analysis 
procedures for the evaluation are also described. (Author/DGC) 
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BEST core AVAILABLE 



RATIONALE FOR STUDY 

During the sununer of 1974 nearly 600 teachers at 15 sites scattered 
throughout Appalachia received graduate education courses via satellite. 
The two courses offered in the summer were a Diagnostic Prescriptive Reading 
Instruction course for K-3 grades and an Elementary Career Education Course 
for grades K-6. Each course consisted of 12 instructional units. Each of 
these \2nits included a one-halt hour, pretaped televised program, a 15 minute 
audio review of the program content immediately following the program, and 
one-to-two hoxurs of preplanned laboratory activities during which the 
teachers used materials and applied procedures relevant to the unit topic. 
During the session immediately following the completion of each unit, an 
achievement test was given, so that the teachers could learn how well they 
understood the concepts in the unit. 

In addition to the learning activities in every unit, four times 
during each course there also were 45-mlnute, live, interactive seminars 
during which the teachers at the local sites were able to ask content 
ei^erts questions. The questions were relayed from the local sites via 
ATS-3 to the broadcasting studio at the Resources Coordinating Center 
(RCC) In Lexington, Kentucky. Moreover, to supplement these instructional 
activities, an on-site reference library and several conputerized retrieval 
systems were made available to the teachers. 

It should be made explicit that, while the Appalachian Education 
Satellite Project (AESP) provided quality in-service education for teachers 
In Appalachia, it was primarily an experiment to demonstrate the feasibility 

1 
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of delivering such courses via satellite to sparsely populated areas. For 
this reason, many of the learning activities were designed for delivery via 
satellite. The pretaped proarams, the live seminars, and the audio questions 
for inroediate review of the program content were a31 transmitted to the 
classroom sites via ATS*6 satellite. Information requests and the seminar 
questions were relayed via ATS-3. 

From t!ie time these courses were conceived, it wae recognized by 
the designers of the AESP that course developers, potential users, and 
funding agonciec would need accurate information about the quality of 
the instructional materials in orde^' to make informed decisions abrut 
planning other courses and refining, revising, and reusing the course 
materials. For this reason, the RCC Evaluation Con«)onent was created to 
collect information on the effectiveness of the courses* The RCC Evaluation 
Component be jar its evaluation of the summer courses by identifying 
questions for which empirically based answers might be requested. 

- How much did the participants learn? 

* To what extent were the participants persuaded to adopt 
a more positive attitude toward the course objectives? 

- How well did the participants like the course and the 
different learning activities? 

- How well dxd the equipment used to transmit instruction 
and information work? 

- What were the characteristics of those taking and 
administering the course? 

- What is the relative effectiveness of each of the 
activities in the learning sequence? 

o 
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After identify iny the questions users and producers might want to 
answer, the RCC Evaluation Component devised an evaluation plan that allowed 
for the collection of the inforination necessary to answer these questions. 
The plan called for the implementation of several evaluation strategies: 
pro-post course testing of the cognitive and affective behaviors of the 
participants; achievement testing after each unit of instruction; user 
rating of the different presentation modes; descriptive documentation of 
equipment, facilities, persoimel, and participants; and a field study on 
the additive iBpapt of three activities the course learning sequence. 

The section in this technical report entitled "Evaluation Strategies" 
describes both the design used to collect the needed information and the 
materials that wfre developed to implement each strategy. The next 
section, "Iniplem«2ntation of Evaluation Strategies," describes some of the 
procedures developed to make possible the implementation of the evaluation 
scheme by local coordinators. Ihe final section, "Analysis of the Data," 
describes the procedures used to transform the raw data into meaningful 
units of information. 
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EVALUATIQN STRATEGIES 

Pre-Posttesting of Cognitive Behaviors 

The need for the pre-posttest design arose from the fact that most 
of the participants possessed sone knowledge of the subject prior to the 
course. Consequently, the success of the total course or single units in 
the course could not be judged from the mean on the posttest alone. It was 
the pre- to posttest gain that was centrally related to the evaluation of 
course or unit effectiveness. It was necessary to know what the pre- to 
posttest gains were before answers could be formulated for such questions 
as "How much difference did the course or unit make on the knowledge and 
skills of the participants?" and "Did the amount of gain differ across 
sites or geographic groups of sites? 

In order to find out how much the participants learned during 
the course, the RCC Evaluation Ccanponent decided to test them prior to 
the course, after each unit in the course, and after the coni>letion of 
the course. The pretest included all the unit and posttest it<#ms. rWie 
participants were given the pretest during the organizational meeting, and 
each unit posttest at the beginning of the next session following the 
meeting when the unit materials were presented, and the course posttest 
on the last d-y of class. Unit tests were delayed until the next class 
meeting because the learning sequence for each unit included the homework 
activities completed during the intervening week, as well as the pre- 
progra"! preparation, the televised program, the audio review, and the 
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laboratory period. The course posttest measured how much the participants 
learned during the total course, while the unit tests measured how much 
the participants learned during each unit, a learning sequence of shorter 
duration than the total course. 

It should be pointed out that the unit tests, developed by the 
PCC Evaluation component, served instructional as well as evaluative 
functions. The tests allowed the participants to demonstrate how effective 
the nuiterials and activities in each unit had been in teaching the behaviors 
identified in the unit objectives. They also gave the participants an 
opportunity to check their understanding of the concepts and skills 
Introduced during the unit, since correct-answer keys were s\?>plied by the 
RCC Evaluation Component for posting immediately after the participants 
were tested. 

The courses focused on the identification of concepts and procedures 
helpful to teachers when planning reading and career education instruction. 
For this reason, the test items focused mainly on the first three levels 
of the taxonomy of educational objectives (see Bloom, 1956) - knowledge, 
comprehension, and application. Although the developers of instructional 
and evaluative materials wanted to emphasize application skills, it was 
necessary to provide co*/erage of many knowledge and con5>rehension 
objectives in the process. Whenever possible the questions to measure 
performance on these objectives were in the form of simulated classroom 
situations. 

Items from different iinits in the K-3 reading course demonstrate 
the three major types of multiple-choice items generated. Unit 9 in the 
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Descriptive and Diagnostic Reading Instruction coiirse focused on instruc- 
tional procedures for teaching word-recognition skills. The following test 
item covered what Bloom in his taxonomy calls a knowledge-level cognitive 
objective, that "the student can identify different strategies for teaching 
word-recognition skills." 

Knowledge Level Test Item: 

The student traces a word* saying each part as he traces it. 
Then he writes the word on the board to check to see if he 
knows it. Which of the following programs does this most 
resemble? 

1 . DISTAR 

2. Discovery Phonics 
*3. Fernald 

4. Sullivan 

Unit 11 in the K-3 reading course focused on instructional procedures 
for teaching reading comprehension. Hie followlro test item illustrates 
the kiu*^ of question covering what Bloom categorized as a con^rehension 
level objective. By answering the item correctly the student demonctrated 
that he could "determine the level of reasoning different types of 
questions would encourage in his students." 

Conprehension Level Test Item: 

Mrs. Glass asked her students * "If you were the boy in the 
story, what would you have done?" What level of reasoning 
was she helping them develop? 

1. Evaluation 

2 . Analysis 

3 . Knowledge 

ERIC *4. 
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Unit 5 in the D?P1 course for grades K-3 focused on the use of the 
Reading Miscue Inventory to determine which reading strategies a student 
is weak in. The following example test item offered the students an 
opportunity to apply skills learned, lhat "the student can record 
information on the coding sheet", is an objective at the application-level 
according to Bloom's taxonomy. 

Application Level Test Item: 

Which of the letters would you write in the graphic acceptability, 
semantic acceptability and meaning change columns on the RMI 
coding sheet for the sentence: 
came 

"The noise ceased." 

1. N,N,N 

2. P,P,y 
*3. P,N.y 

4j N.f.N 

Unit 1 in the summer career education course for elementary school 
teachers focused on the concept of career education. The following test 
item is for the objective at tne knowledge level, that "the student recognizes 
developers of concepts of career education." 

Knowledge Level Test Item: 

To which individuals goes the credit of coining the term 
"career education"? 
- 1; Carl Parkins and James Barclay 

2. Dwight Alfield and Robert Hoyt 

3. Jamea Borrill and Robert Bailey 
*4. Janes Allen and Sidney Marland 

ERIC 
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Unit 2 in the summer career education course for elementary 
school teachers focused on components of a comprehensive career education 
program. The following test item is for the objective at the comprehension 
level, that "the student can distinguish reasons for implementing career 
education. 

Comprehension Level Test Item: 

Miss Everett decided that her two top third-grade students. 
Bob and Susan, did not have to take part in career education 
activities, because their time :^ould be better spent expanding 
their academic knowledge. M;Lss Everett's decision is: 
1. Correct because advanced students generally do not have 
any difficulty in the employment market. 
*2, Incorrect because career awareness serves as an 
enrichment activity for the advar»ced student. 

3. Incorrect because career awareness is geared more towards 
the advanced student. 

4. Correct because if a student has a sufficiently high 
level of academic achievement he will not i*eed any 
career training until college. 

Unit 8 in the summer career education course for elementary 
school teachers focused on implementation strategies for career education 
in the schools. The following test item is for the objective at the 
application level, that "the student can apply career education concepts 
to career education programs . " 



AppXicatlon Level Test Item: 

Miss Adler attended a workshop on career education and became 
quite enthusiastic about the concept. She decided to try to 
implement a career education program on a school-wide basis. 
Her first step would be to: 

1. Discuss a school-wide career education program with 
her principal and convince her of its need. 

2. Set up a planning team of fellow teachers. 

3. Organize a series of workshops and in-service sessions 
dealing with careei; education. 

*4. Implement career education in her own class before 
trying to establish a school-wide program. 

Pre-Posttesting of Affective Behaviors 

One way to improve the quality of education available to students 
in Appalachia is to increase through in-service courses the number of 
effective instructional procedures with which teachers in Appalachia are 
familiar. However « unless the teachers feel that these procedures are 
worth the time taken to learn them, it is unlikely they will ever in- 
corporate them in their classroom. Should this happen, the course would 
have little effect on the quality of instruction the Appalachian student 
receives. 

In order to obtain some idea about the receptivity of the participants 
to the ideas and procedures advocated in the AESP courses, the VCC Evaluation 
Component added to the pre-posttest design an affective, a« well a^r 
cognitive, dimension. The affective pre-posttest, like the cognitive 
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pre-posttest for the course, was given during the org;iiii2ationa\ and 
final class meetings. The participant was asked to 'nark the point on a 
5-point Likert scale that best described his attitude toward each state- 
ment. 

The Teaching Attitudes Toward Reading Instruction (TARI) , the affective 
pre-posttest for the Reading Instruction course (DPRI) for K-3 teachers, 
allowed the participants to express their attitudes toward five ideas: 

1) That diagnostic and prescriptive reading instruction is 
a good way to teach reading (see items 4, 7, 12, 14, 16, 
19, 24, 30, 35 on the TARI in the appendix); 

2) That diagnosis of individual needs is the necessary 
first step in the effective teaching of reading (see 
items 3, 9, 10, 11, 20, 23, 27, 31, 34 on the TARI); 

3) That teachers should integrate the learning of word 
recognition and romprehension skills with the develop- 
ment of other language arts (see items 1, 13, 21, 22, 
26, 33, 36 on TARI) ; 

4) That teachers can help their students develop pre- 
reading skills (see items 2, 5, 17, 29, j2 on TARI); 

5) That recognizing individual words is less indicative 
of a child's reading skill than his ability to 
comprehend the meaning of a passage (see items ^, 8, 
15, 13, 25, 23 on the TARI). 
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The l\eacher Attitudes Toward Career Education (TACE) , the 
affective pre-posttest for the course in career education instruction for 
K-6 teachers, allowed the participants to express their attitude toward 
three ideas: 

1) lhat the place for career education instruction is in the 
school curriculum (see items 1, 2, 3, 8, 9, 11, 12, 13, 
14, 17, 21, 23, 24, 25, 26, 29 on the TACE in the 
appendix) ; 

2) That career education instruction should be integrated 
with academic subjects in the classroom (see items 4, 
5, 6, 7, 15, 16, 19, 22, 27 on the TACE): 

3) That career education is not synonymous with vocational 
education (see items 10, 18, 20, 28, and 30 on the TACE). 

Pre-Post Description of Teaching Practices 

In order to obtain information on the effect each course had on actual 
classroom teaching procedures and ultimately on the elementary student, the 
RCC Evaluation Component planned a field follow-tjp study for the 1974-75 
school year. The study was to include classroom observations of a sanple of 
the teachers who took the course and comparisons of the achievement scores 
of their students and the students of other teachers who did not take the 
course. 

Due to limited resources the study has been narrowed in scrope. it now 
includes only self-report data from the course participants and no class- 
room observations. Prior to the course all the participants were asked 
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to describe their teaching procedures for the 1973-74 ^5chool year (see the 
Teaching Practices Inventory: Reading/Career Education in the appendix). 
In January, 1973, a sample of the sominer course parti c .pants will receive 
through the mail the Attitude Questionnaire and Teachi ,g Practices Inventory 
This time they are asked to fill our. the foCT\s in such a way as to reflect 
tteir course-related attitudes and teaching practices is of the end of the 
fall term of the 1974-75 school year. 

The Teaching Practices Inventory: Reading (TPIR) and the Teaching 
Practices Inventory: Career Education (TPICE) forms ara basically multiple- 
choice in format with some dichtomous questions and checklists. The 
participants were asked to check the answer that best djscribed their 
teaching practices. As an example the TPIR gathered information on: 

1) nie diagnostic techniques the participants used to 
teach reading (items 9, 10, 11, 12, 13, 14, 15, 16, 17 
on the TPIR) ; 

2) The instructional techniques the participants used to 
teach reading (items 1, 2, 3, 4, 5, 6, 7, 18, 22, 23, 
24, 25, 26, 27 on the TPIR) ; 

3) The resources already available that could be used to 
construct effective instructional activities (items 8, 
19, 20, 21, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 46 
on the TPIR) ; 

4) The extent to which the participants tended to become 
involved in curriculum and resource collection planning 
(items 38, 39, 40, 41, 42, 43, 44, 45, 47, 48, 49, 50 
on the TPIR) , 
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The structure of the TPICE Is the same as the TPIR except that it 
refers to the teaching of Career Education. Differences in teaching 
practices can be, partially at least, attributed to the course. In the 
sane sequence^ the summer course participants were also asked to express their 
attitudes toward the statements on the TARI or TACE Ouestionnaires . Results 
from the three administrations of this form are to be compared to find out 
whether changes in attitude produced by the course tended to remain stable 
across time. 

User Ratings of Learning^ Activities 

One way to find out how effective the learning activities were is 
to ask those who actually participated in the activities how they liked 
them. The RCC Evaluation Component decided to tap this source of information 
by giving both the participants and the course coordinators the opportunity 
to express their opinions of the instructional materials, equipment, and 
procedures. Questionnaires developed by the RCC Evaluation Component 
allowed the site monitor and the participants to assess the technical and 
content quality of: (1) the 12 taped televised programs; (2) the live 
seminars; (3) the 12 audio review segments; (4) the laboratory exercises 
(12 separate sets of activities for reading and 6 separate sets of 
activities for career education); (5) the information retrieval systems; 
and (6) other instructional activities, such as the pre-program preparation, 
the homework, and the xinit tests. 
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E^faluatlon of Television Prograwa 

To gathar information helpful in answering such questions about the 
television programs as "Was the program interesting?" and "Was the information 
in the program clearly presented?", the RCC Evaluation Oonponent developed 
the Quality of TV Reception (QTVR) , the Televised Lecture Questionnaire (TLQ) , 
the Seminar Questionnaire (SQ) , and the Instructor Feedback Questionnaire 
(IPQ) . The participants were asked to express their opinion of technical 
and production features of the 12 pretaped and 4 live television programs 
by marking the point on a 5-point Likert Scale that best characterized 
their attitude toward the statements. Observers, such as the site 
coordinators or consulting faculty menbers, had the opportunity to express 
their ppinions of the televised programs and seminars on the Obser/ation Log 
(OL). (Copies of these instruments appear in the appendix.) 

the Televised Lecture Questionnaire (TLQ) measured the attitudes 
of the participants toward the pretaped programs, flie TLQ allowed the 
participants in each course to rate the effectiveness of the following 
features of the 12 televised programs t 

1) Ihe usefulness to the classroom teacher of the concepts 
and procedures presented during each of the programs 
(items 16, 26, 27 on the TLQ); 

2) The clarity and coherence of the program (items 6, 7, 
10, 12, 18 on TLQ); 

3) The concreteness of the presentation (items 9, 11 on 
(TLQ); 

4) The quality of the viewing conditions (items 1, 2, 3, 4, 
24 on TLQ) ; 
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5) The effectiveness of the televised program as an 
instructional activity (items 5, b on TLQ) ; 

6) The acceptability of the presentation (items 13, 14, 
15, 13, 22, 23 on TLQ) . 

The Seminar Questionnaire (SQ) measured the attitudes of the 
participants toward thfe live seminars. Itie SQ allowed the participants in 
each course to rate the effectiveness of the features of the 4 live seminars: 

1) The efficiency of the question-collection procedures 
(items 5, 6 on SQ) ; 

2) The clarity and coherence of the different topics 
(items 8, 9, 17 on SQ) ; 

3) The adequacy with which the issues were covered (items 2, 
10, 16 on SQ); 

4) The usefulness to the classroom teacher of the information 
convey»d during the discussion segments (items 3, 4, 19 

on SQ) ; 

5) The value of the film segments included in the seminar 

as supplements to the live discussion (items 1, 21 on SQ) ; 

6) The value of the seminar as a learning activity 
(items 7, 11, 12, 13, 14, 15, 18, 20 on SQ) . 

Evaluation of Audio Re'/iew 

The RCC Evaluation Component realized the need to rn llect information 
useful in answering such questions as "Did the audio r^jview supi iement ideas 
introduced during the televised lectures?", "Were lift like problems posed?", 
and "Were the ejfplanations clear?" Per this reason the User Pour Channel 
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Audio (UFCA) form was developed and appropriate items were inserted in the 
Instructor Feedback Questionnaire and the observation Log to enable course 
participants and site monitors to express the?r opinions of the technical 
and presentation features of the 12 audio reviews. The review questions 
followed the televised program in the learning sequence of both the K-3 
reading and the elementary career education courses. 

The User Four Channel Audio form gathered information on the 
participant's attitudes toward: 

1) The quality of sound (items 1, 2, 3 on UFCA) ; 

2) The acceptability of the announcer's voice (items 10, 
11 on UFCA) t 

3) The quality of the explanations (items 15, 16, 17 on UFCA); 

4) The usefulness of the content covered for classroom teachers 
(itetrs 12, 14 on UFCA): 

5) The acceptability of the timing and the synchronization of 
the questions and answers (items 4, 5, 6, 7 on UFCA); 

6) The acceptability of the audio review as an instructional 
activity (items 8, 9, 13 on UFCA). 

evaluation of Practice Exercises 

Preceded by the televised program and the audio review, the 
laboratory activity is the thir^ in-class activity in the learning sequence 
for each unit. Many questions about the practice activities arise, such 
as "Wore the instructions given by the site monitor clear?" and "ITere the 
materials used and the skills practiced in the laboratory actually useful 
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to a classroom teacher? To collect the information necessary to answer 
these and other questions, the RCC Evaluation Conffjonent developed the 
Laboratory Activities Questionnaire and inserted appropriate items on the 
Instructor feedback Questionnaire and the Observation Log, 

The Laboratory Activities Questionnaire (LAQ) collected information 
on the attitudes of the participants toward: 

1) The cohesiveness of the practice activities (items 1, 2, 
13, 15, 16 on LAQ); 

2) The efficiency with which the practice activities were 
administered (items 6^ 7, 18^ 19 on LAQ) ; 

3) The timing of the laboratory activities (items 10, 11^ 
12, 14 on LAQ); 

4) The value of the activities to the classroom teacher 
(items 4, 17, 19, 53 on LAQ); 

5) The value of the laboratory as an instructional activity 
(items 8, 20, 21, 22, 55 on LAQ). 

Evaluation of Supplementary Aids to Learning 

In addition to the three in-class learning activities for each 
unit (the televised program, audio review and laboratory activities), the 
participants were aslced to esgpress their satisfaction with such supplementary 
learning aids as the on-site libraries, the retrieval systems, made 
available, the vinit tests, and the homework activities. 

To collect information on the opinions of the reading course 
participants about the Select-Ed and the Texas Computer Retrieval Systems, 
and to gather infoniu»tion on the opinions of the participants in the 
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career education course about the ERIC. AIM, AFM, RIE, CUE and CDRU 
infonnation-retrieval systems, the RCC Evaluation Component developed the 
Reading/Career-Educatior Information System user Satisfaction Questionnaire 
I^CEISUSQ) . The participants were asked to marl the point on a 5-point 
Likert scale that best expressad their attitude toward statements about: 

1) The training packeges (: terns 1, 2 oh R/CEISOSQ) j 

2) The individual request forms atems 3, 4 on P/CEISUSQ)/ 

3) The turn-around time for the system (items 5, 6 on R/CEISUSQ) ; 

4) The appropriateness of the information received (items 7. 
8 on R/CEISUSQ) ; 

5) The completeness of the information received (items 11, 12, 
13, 14 on R/CEISUSQ) ; 

7) The usefulness of the information received (items 15, 16 
on R/CEISUSQ). 

To find out how at different points in the course both the 
administrators and the participants felt about the different instructional 
and evaluative procedures, tha RCC Evaluation Component developed the 
Instructor Feedback Questionnaire (IFQ) . This form was administered three 
times during the course. The p«u:ticipants were asked to rate on a 5-point 
Likert scale the amo\int of information they received from each of the 
instructional activities, usirg as their basis for comparison similar 
aspects of traditional graduate education courses: 

1) The preprogram preparation con5>ared to work usually assigned 
in other graduate classes (item 1 on the IFQ in the appendix) ; 

2) The taped televised program compared to a graduate lecture 
(item 2) ; 
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3) Hhe live seminar coii¥)ared to other graduate seminars and 
class discussions (item 7); 

4) The audio review compared to class quizzes followed 
by a discussion of the answers (item 3) ; 

5) The practice activities compared to l£UDoratory activities 
performed in other graduate education courses (item 4) ; 

6) The follow-up homework activities compared to home-work 
assignments in other graduate courses (item 8) ; 

7) The unit tests con5)ared to teacher-made unit tests in 
other graduate courses (item 9) ; 

8) The information-retrieval systems compared to supplementary 
materials instructors in other graduate courses locate to 
help specific individuals (item 6) j 

9) The on-site reference materials compared to materials 
placed on reserve by other graduate instructors (item 5). 

Since it was likely that some participants would withdraw from 
the course, the RCC Evaluation Component prepared the Student Withdrawal 
Form to find out how drop-outs felt about the course, ihis form gathered 
information from former course participants on: 

1) The benefits they received frar. the course during the 
time they were enrolled (item 1 on SWF in the appendix) ; 

2) Their interest in taking similar courses (item 2 on SW)j 

3) Their reason for withdrawing (item 3 on SWF) ; 

4) Any suggestions they had for improving the course 
(item 4 on SWF) . 

ERIC .n 



20 



Observer Rating of Learning Activities 

Another source of information on the effectiveness of course 
materials and procedures are those observing and monitoring the ac;tivities 
of the course participants. To find out the opinions of the site coordinators 
and the consulting faculty menbers whenever they were present, the RCC 
Evaluation Component developed the Observation Log (OL) . After each session 
the site coordinator was asked to record his opinion of; 

1) The value to the classroom teacher of the information 
conveyed by the different learning activities; 

2) The excellence of the presentation; 

3) The acceptability of the activities to the participants; 

4) The cohesiveness of each unit's instructional and 
evaluative activities. 

On the Summary Report Form (SRF) the course administrators were 
asked to express their over-all satisfaction with the different instructional 
and evaluative activities. (Copies of all these attitudinal instruments 
appear in the appendix.) 

Field Study on Additive Value of Learning Activities 

The RCC Evaluation Comfonent designed a three-group study to 
gather information helpful in 2uiswering such questions as "What is the 
additive impact of the different instructional activities in each unit?" 
and "What would be the effect of deleting one or more of the instructional 
activities in the learning sequence?" 
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The three-group study was rxin on 2 of the 12 units in each of the 
sisnner courses. For each ejqperiment the participants at each site were 
randomly assigned to the three groups. The three groups received varying 
portions of the instrxictional sequence before tney took the unit test. 
Group 1 took the unit test after they had seen the televised program; 
gro^p 2, after they had seen the televised program and participated in 
the audio review; group 3, after they had seen the televised program, 
participated in the audio review, and performed the laboratory activities. 
By comparing the performance of the groups, it will be possible to assess 
the additive inpact of the activities in the learning sequence. 

Doc-Jientatlon Reports 

Technical Factors 

Before any evaluation of the effectiveness of the instructional 
materials is possible, it is necessary to know how much of the learning 
sequence the participants at each site actually received. W;is Is 
especially true in a course where the amount of instruction the participants 
received was highly dependent on good television reception. 

For this reason, not only were there a few technical items on 
each of the learning activities questionnaires, but also there was a 
separate Quality of TV Reception Questionnaire (QRVR) which a few users 
were asked to fill out after each live seminar or pretaped televised 
progr2un. On the QTVR they expressed thoir opinions about: 

1) The quality of the audio reception (items 1, 2, 3, 4, 
5 on QTVR); 
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2) The quality of the video reception (items 6, 7, 8, 10, 

11 on QTVR); 

3) itie synchronization of the audio and the video (items 9, 

12 on QTVR). 

An uncomfortable learning environment can also interfere with 
learning. To find out something about the quality of the learning 
facilities r the site coordinators were asked at the beginning of the 
course to record on the Learning Facilities Descript.lon (If D) : 

1) flie suitability of the TV equipment (items 1, 2, 5 on 
IJ?D in the appendix) ; 

2) The maximum and mibimum viewing distances from the 
television set (items 4, 14, 15, 16, 17 on LFD); 

3) The adequacy of the seating arrangement (items 3, 4, 
6, 7 on LFD) ; 

4) The adequacy of the classrooms (items 12, 13 on LFD) i 

5) The adequacy of the physical accommodations (items 8, 9, 
10, 11 on LFD). 

If particular conditions, such as the shape of the seating 
arrangement, correlate highly with poor achiev^ent, these conditions 
should be avoided in the future courses. 

Much of the course instruction is delivered by means of a satellite 
telecommunications system. For instance, the pretaped programs are relayed 
from the earth transmission station in Rosman, N.C^ to ATS*6 that sends 
the signals on to the sites. Malfunctions in equipment at the earth 
station, on the satellite or at the ground stations mar the quality of 
the transmisL/ion. Moreover, technical problems at the telephone coc^any 
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can seriously affect the quality of the live, interactive seminar, 
since the seminar broadcast is carried over telephone lines from the 
studio in Lexington, Kentucky, to the uplink at Rosman. 

To identify where equipment malfunctions occur and record the 
efficiency of the repair procedures, the RCC Evaluation Component developed 
the Equipment Trouble Log (ETL) . On this form the site coordinator 
identified: 

1) The equipment that broke down; 

2) The company and person contacted to repair the equipment; 

3) The problem that reportedly caused the breakdown; 

4) The length of the time required to complete each step 
in the repair process. 

The frequency with which various kinds of equipment broke down can 
provide an index to equipment reliability. Categorizing the causes for 
these malfunctions can identify aspects of the equipment that may need to be 
redesigned. Comparing the average time required to fix each kind of repair 
can provide an index to the efficiency of the service procedures . 

Demographic Factors 

To find out what the participants and administrators in the course 
were like and what effect, if any, demographic characteristics had on the 
effectiveness of the materials, the RCC Evaluation Component developed back- 
ground questionnaires on which site coordinators and participants identified 
some of their characteristics. On the Confidential Background Ouestionnaire 
(CBQ) the participant gave his: 
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1) Sex and age; 

2) Type of community were he worked; 

3) Scores on national tests; 

4) Number of years of general course -related teaching experience; 

5) Graduate and undergraduate grade point average; 

6) Formal education status; 

7) Number of graduate and undergraduate education courses in 
the course area; 

8) Type and location of current employment. 

with this information, the participants can be divided into groups 
on the basis of one or more factors (sex, age, standardized test scores, 
teaching experience, number of courses in the subject). If particular 
background variables explain the variance among the participants on the 
pre-posttest, it may be possible to identify which type ^f person benefits 
roost from the course, (see the appendix for the background questionnaires 
for course participants, site coordinators, and consulting faculty.) 

Performance can also be greatly affected by absenteeism, since, if 
a participant is not there to receive instruction, it obviously makes no 
difference how good or bad the instruction is. Tlierefore, to calculate 
accurately the effectiveness of the instruction, it was necessary to assess 
the effect of this variable. To make possible the keeping of accurate 
attendance records, the RCC Evaluation Component devised the Attendance 
Record Form. 
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IMPLEMENTATION OF EVALUATION STRATEGIES 

The RCC Evaluation Component developed instrument distribution, 
administration, and collection procedures that required as little of the 
site coordinator's time as possible. This was necessary, since the site 
coordinators spent most of their time monitoring instructional and 
technical procedures. The effort to simplify the evaluation role of the 
site monitor, while still collecting the data necessary to answer fundamental 
questions about unit and course effectiveness, led to the development of the 
individual evaluation materials packets, the instrument collection box, and 
the sits coordinator's manual. 

The individualized evaluation materials packets were the means 
whereby the evaluation materials for each session were preordertd, pre- 
distributed, and prelabeled. As the participants came into class, they 
picked up the packet identified with their student number, inside they 
found the evaluation forms and matching answer sheets that they would need 
during the day. All the site coordinator had to do was tell the participants 
when to fill out a form; he did not have to decide who should get which 
forms or take time to pass out the forms and answer sheets. 

The premetered, preaddressed instrument collection box was the means 
selected to collect and package the evaluation materials that were to be 
ractiled back to the RCC. As the participants completed an evaluation form, 
they placed, in the box designated for that purpose, the answer sheet and 
sometimes the instrument itself if answers were written directly on the 
form. All the site coordinator had to do was place the box, prior to the 
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class, at a standard location. Once all the evaluation materials for the 
day were placed in the box he had only to seal it and drop it in the 
mailbox. 

One of the objectives of the Appalachian Education Satellite 
Project is to determine whether graduate -level courses can be conducted 
without on-site content professors. Since site coordinators were not subject 
matter experts or trained evaluators, the rCC Evaluation Component provided 
theiA wxth detailed instructions for carrying out instructional and 
evaluative procedures. These instructions were contained in the "Site 
Coordinator's Procedures Manual". The daily schedules in thie manual, pre- 
pared by the RCC Evaluation Component, specified the tasks that the site monitorc 
needed to perform during each session. Time sequencing the task descriptions 
provided the site monitors with an easy checklist to refer to during each 
class. 

In order to study relationships among the variables included in 
the design and make pre-posttest comparisons, the RCC Evaluation Component 
devised the student number system that linked together responses made by 
the same individual. Using student numbers rather than the real names of 
the participants protected the participants from invasion into their privacy 
and allowed them to report their true perceptions of the course with some 
assurance of anonymity. These numbers will be changed on the final 
dr.tA tape before it is released to other researchers, making it 
virtually Impossible ever to associate specific responses with a particular 
individual . 
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•n»e procedure for assigning student numbers was fairly sitnple. 
The first two digits in the student number identified where the student was 
taking the course. The first digit indicated the RESA tricngles in which 
the site was located; the second digit named the site, resa triangles are 
made up of 3 geographically close sites. Since there were 15 sites, there 
were 5 resa triangles. 

TABLE 1 
CLASSROOM SITES 



Triangle Main Sites Ancillary sites 



1. 


New York - 


Pennsylvemia 


*Fredonia, N 


.Y. 


Olean, N.Y. 
Edinboro, Pa. 


2. 


Tennessee 




•Ltf^'olletta, 


Tenn. 


♦Coalfield, Tann. 
Johnson City, Tenn. 


3. 


Virginia - 


North Carolina 


•Norton, Va. 




Sticklyville, Va. 
•Boone, N.C. 


4. 


Maryland - 


West Virginia 


•Cumberland, 


Md. 


Keyser, W.Va. 
NcHenry, Md. 


5. 


Alabama 




*Huntsville, 


Ala. 


Guntersville, Ala. 
Ralnsville, Ala. 



•Site equipped with four-channel audio encoder-recorder. 



At seven sites there wae an encoder-recorder that electrically 
recorded the responses the participants selected as answers to the audio 
review questions. Since the same student had to use the same response pad, 
so that the encoder could identify the student, it was necessary to 
assign permanent seats. The four-channel audio equipment iagrant was 
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designed by the RCC Evaluation Component to standardise the position of 
each response unit. (See appendix for a copy of the layout diagri«.) 
This nade it possible to use the two numbers on the four-channel audio 
response pad at the participant's permanent seat as the last two riumbers 
in his unique student number. 

Evaluation materials packets were made up for each student number. 
Hie student number appeared on every evaluation answer sheet in the packet. 
TO correct for errors that might be made in preparing the packets, the site 
monitor was asked to remind the participants that they were to check each 
answer sheet to make sure their correct student number was on it. Should 
anyone ever forget this student number, a copy of the seating chart with 
everyone's number on it was posted. (See appendix for a copy of the 
seating chart.) 

To reduce the amount of time each participant spent filling out 
evaluation forms, the forms were randomly divided among the participants 
in such a way that only part of the participants filled out each form. 
In Table 2 are listed the number of times each evaluation form was filled 
out and the maximum number that filled out the form each time. 
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TABLE 2 

EVALUATION ADMINISTRATION 'FREQUENCY CHART FOR 
AESP SUMMER COURSES IN READING AND CAREER EDUCATION 



Instrunftnt Frequency of Number Participating 

Administration per Site 



Audio Review 


12 




20 


Televised Lecture Questionnaire 


12 




9 


User Four Channel Audio 


12 




8 


Quality of TV Reception 


16 




3 


Laboratory Activities Questionnaire 


12 


(6 in C£) 


10 (20 in CE) 


Seminar Questionnaire 






17 


Teacher Attitudes Toward R/CE 


2 




20 


unit Tests 


12 


(11 in CE) 


20 


Pre-Posttest 


2 




20 


Oonfidentlal Background Questionnaire 


1 




20 


Teaching Practices Inventory: R/CE 


1 




20 


R/CE Information System User Satisfaction 


1 




20 


Student Withdrawal Form 0 


-1 




Unknown 


Site Monitor Questionnaire 


1 




1 


Consulting Faculty Questionnaire 


1 




1 


Observation Log 


7 


(8 in CE) 


1 


Equipment Trouble Log 


7 


(8 in CE) 


1 


Learning Facilities Description 


1 
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ANALYSIS OF TTiE DATA 

The different evaluation strategies made possible the collection of 
data necessary to answer basic questions about course effectiveness. How- 
ever, to find out vrtiat the raw data means, it is necessary to perform 
various analyses. Future technical reports, produced by the RCC Evaluation 
Conponent, v/ill present the results of these analyses of the data. 

Pre-Posttest Analysis Procedure 

A repeated measures analysis of variance is to be performed on 
the data from the pre- and posttests. In the analysis of variance design 
for the 8u»amer courses, the five RESA triangles constitute the five levels 
of one factor, an J the occasions, pre- vs. post-course, constitute the two 
levels of a second factor. Assuming that the participants are more 
homogeneous within RESA triangles than among RESA triangles, RESA triangle 
is included as a blocking variable when making pre-posttest comparisons. 
Since there are three receiving stations In each RESA triangle, site- 
withln-trlangle becomes a third factor In the design. Figure 1 depicts 
the three factor, nested design for the single and cumulative Instructlwn 
units. 

The basic design can be used for the total course and unit pre- 
and posttests administered during the course. The test questions grouped 
by objective and unit provide another set of subtest scores. A multi- 
variance analysis of variance is appropriate for such ca^es. Since the 
participants responded to the same Item on two testing occasions, there 
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Factor A - Occasions (pre and post course) 
Factor B » RES A Triangle 
Factor C - f ite-within-triangle 

^^g- }" Design for the evaluation of units and the total course. 
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is a pretest and a posttest score for each subtest. The gain scores for 
unit test scores make it possible to estimate the effect of the instructional 
materials in each unit. 

To incorporate the repeated measures factor (pretest vs . posttest) , 
the pre- and posttest scores are replaced in the analysis with the mean 
and the difference between the two scores. There are 2p variables where 
p test scores are involved (p means and p differences) included in the 
nested two-way, multivariate analysis of variance design. The cell mean 
model for such a design is 

Y. - K e + E., 

15x2p 15x15 15x2p 15x2p 
where Y. is the matrix of cell means for the 2p variables, K is the 
reparameterized design matrix, 0 is the matrix of contrasts, and E. is 
the residual matrix. 

Least-squares estimates of the contrasts are obtained using the 
procedures specified by Bock (1963). These procedures are appropriate for 
non-orthogonal designs which result from unequal cell sizes. 

The data aiialysis is carried out using the Finn (1966) 
"Multivarianctj" computer program. Multivariate tests of the hypotheses 
for the design are performed with the likelihood ratio statistic. This 
statistic, if transformed to an F statistic, is referred to as a multi- 
variate F. Table 3 presents symbolically the multivariate testing of 
the hypotheses of interest in the design. 
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TABLE 3 



ANALYSIf) OP VARIANCE 



Source 



df 



Multivariate 



Between Subjects 
BESA Triangle 
Sites Within Triangles 
Error Between Subjects 



4 

10 



P. 



s|t 



within Subjects 

Gain (Pre vs. Post) 

Gain x Triemgle 

Gain X site within Triangle 

Error within Subjects 



1 
4 

10 



P 



gt 



gs|t 



TOTAL 



N 



P^ is a statistic far testing the hypothesis tha performance on 

all ijubtestj is the same for all RESA triangles. P , is a statistic for 

S|T 

testing the hypothesis that performance on all subtests is the same for 

all sites with triangles. P is a statistic for testing the hypothesis 

G 

that for all subtests there is no gain from pretest to posttest. F 

Gt 

is a statistic for testing the hypothesis that there is no interaction 

of gain anr" angle; that is, that the amount of gain does not vary as 

a function < SA triangle. P^„| is a statistic for testing the hypothesis 
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that there is no interaction of gain and site-within triangle. For any of 
the multivariate F's that is significant, inspection of the univariate and 
step-down F statistics for the subtests is made. This is necessary in order 
to determine the nature of the pre-post gain on the various subtests. These 
responses made by the participants on the pre-post tests of achievement can 
also be u'.ed to improve the test items during a revision cycle. 

Three-Group Study Analysis Procedures 

The three-group field studies were conducted to determine the 
effect of different learning activities. The three basic activities 
(video, audio review, and lab activities) constitute the three levels of 
the independent variable. The analysis of variance model for the three 
group study is 

Y^. « U + a + for the vid«^o-only group 

Y^. ■M+a+B+e^ for the video and audio review group 

Yy «p + a+ 6 + Y + e3 for the video, audio review, and the lab 

activities group. 

Y^. is the posttest mean of the j-th group, u is the pretest mean of all 
groups, a is the increment in achievement due to the televised lecture, 
B is the increment in achieveroenc due to the audio review, and Y is the 
increment in achievement due to the laboratory activities. 

Actually, for the purpose of determining the size of the gains 
in achievement, the parameter v can be ignored, sJnce the posttest-minus- 
pretest difference scores are used. The models for the mean difference 
scores are 
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d^. » o + e^' 

d_. = a + B + c- . 
2 2 

d^. =«o + e + Y + e3. 

'here d^. is the post- minus -pre test difference in the means for group j. 

The matrix model used in the analysis of the three-grorp study is 





I 0 o" 
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110 




S 
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In Table 4 the analysis of variance table ''or the three-group study 
depicted. 

TABLE 4 

AOV FOR THREE-GROUP EXPERIMEbiT 



f Durce 


ss 


df 


MS 


P 


a 




1 


MS 








1 






Y|aB 




1 


MS 1 _ 
Y|aB 




Error 


SS 

e 


N-3 


MS 

3 




IVJtal 


T 


N 







The null hypothesis that there is no gaiii in achievement due to 
viewing the tele^dsec lecturer ; a « 0^ is tested with F^. The null 
hypothesis that there is no gain in achievement cue to the addition of 
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the audio review to the televised lecture, : 3 » 0, is tested with F«i . 

0 B|a 

The null hypothesis that there is no gain in achievement due to addition 
of the laboratory activities, : Y » 0, is tested with F^i Ihe 
additive value of the three instructional activities in the learning 
sequence is evaluated by looking at the parameter estimates and performing 
the above hypothesis test* 

Analysis Procedures for Attitudinal Instruments 

All of the attitudinal instruments are analyzed by a similar 
four-step procedure. Step 1 involves computing individual item-means and 
frequency distributions across sites* Step 2 requires the performing of 
factor analyses to see whether the actual and hypothesized factor 
structure are similar. Step 3 involves developing scoring procedures 
for each factor, so that individual scale scores can be computed. Step 4 
Zor the pre-post attitude questionnaire requires the comparing of pre-* 
post'scale scores to estimate the change that took place on attitude 
variables. For the instruments measuring the attitudes of the participants 
toward the learning activities. Step 4 involves comparing scaled items 
across units. In this way# strong and weak points are identified within 
each instructional activity and each unit. Total scores for each 
instructional activity are derived by adding up all the scaled values that 
measure the features of one instructional activity. With these scale 
score:; for the instructional activities in each unit, it is possible to 
compare the different instructional activities in terms of their perceived 
value. 
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CONCLUSION 

The evaluation procedxires described in this report were 
implemented in the AESP courses administered during the summer of 1974 « 
The rerultSr to be described in subsequent technical reports^ will be 
presented in such a way that each technical report provides empirical data 
helpful in answering one or more of the following questions. 

1) How much did the participants learn? 

2) To what extent were the participants persuaded to 
adopt a more positive attitude toward the course 
objectives? 

3) How well did the participants like the course and 
the different learning activities? 

4) How well did the equipment used to transmit instruction 
and information work? 

5) What were those taking and administering the course like? 

6) What is the relative effectiveness of all the activities 
in the learning sequence? 

The information in these reports should enable future producers 
of course materials to develop and deliver more effective multi-^media 
courses* 
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ITEM A 



Appalacliian Fducation Satellite Project 
Pesource Coord inatinq Center 
Evnluation Coinponcnt 
306 Fraroe Hall, University of Kentucky 
Lexington, KcntucJ^y 40506 



TF-ACHER ATTITUDES TOVJARD READING INSTRUCTION (TARI) 



Instructions 

Mark all answers on the separate answer sheet — do not write on the 
test itsoli :. In the blanv/ after the wrd "School" at the top o^ the ansvor 
sheet ^Titc tho nnro of t he com;rc you are taking • In the blank after tbc 
word "Tect" \;ri to th ^ abhrcvlri "_c:d nntrc of the tost * In the section labeled 
"Student Mur^.bcT'' localc-d in tlie lov;or right-hand corner of the answer sheets 
write vour 4-^*ioit stiilnnt nup^_^*^ in the. first four boxos. Place a hcnvy 
horizontal Imr* 'iTrV-he^ uppropr^iate spacj in the column under each dio it of 
your student number. 

Indicate your anrv;orp to tho item s by placing a heavy vertical line 
in the column beside the appropriate item number on the separate answer 
sheet. Be sure the item nurnber on the answer sheet matches the iteni number 
on the tost. 

Mark ; 5) if you strongly agroc with the statement 
4) if you moderately agree 

3) if you Tccl ncu'i^ral 

2) if you moderately disagree 

1) if you :^trongly dijvcigrco 

U se a r>oft-3cad (#2) pcnc5 1 to mark the answer sheet — do not use 

^ pen or ball-point. Bo pure yonr mark iills the entire block of the rocpon 

you wish to rake. If you ch.^nqo your mind or nake a mistake r be sure th.it 

you e rase co rplotc ly . Do not make any other marks on the answer t'.i'^ * . 

Please answer as truthfully as possible. Your answers do nw^ affect 
your grade in thr course, but help us to as«^css the effectiveness of the 
course and suggest ixjprovcments. 

1, Kindergarten teachers do not have to worry about teaching students to 
understand stories. 

2* The reason for most student reading problems is inadequate instruction, 

3. If a class is large, there's no way to work with individual... 

4. A third-grade tnncher only ncods third-grade instructional ma tori* is. 



5. Kindergarten teachers should help childr<*n develop reading readiness 
skills. 

6* A studont is a good reader if be can read every v/ord correctly. 

7. Not using every page in the workbook is wast;cful. 

8. Students should not be corrected when they make oral reading errors, 

9. Time spent diagnosing could be Iscttor spent instructing, 

10. If you don't have enough bookr. for all your students, you cannot 
effectively ur>c a set of ncitorinls. 

11. Diagnosing student reading problems is the responsibility of the teacher, 
rather than the school administration. 

12. Scores on standardised tests provide adequate information for instruction. 

13. It is worse to he 6 months behind in first grade than it is to be 
6 months bchifid in th-i.rd grade. 

14. Informal tests are better than standardized tests for placimj students 
at appropriate instructional levels. 

15. Teaching students to understand what they read is rr.ore important than 
to round out the words - 

16. Prencr ii'ti vc instruction is tV.e bcr^t way to teach reading. 

17. There's nothing a teacher can do to develop reading rcadiners in 
studcn' G. 

18. It is more important that a student mder stand? what he reads than 
that he reads without making miscues- 

19. Diagnosing word-recognition weaknesses is more troublo than it's worth, 

20. Information systems linking diagnosis and instruction are effective 
ways to p]an instructional activities. 

21. Vocabulary should be taught through real life experiences. 

22. A child is cither ready to learn to read, or he isn't. 

23. Grouping children on the basis of common skill needs is better than 
grouping them on the basis of instructional level* 

24. Students in your clnns should all read the same thing, so no one feels 
bad. 

25. An analysis of oral reading miscues is more trouble than it's worth. 

26. Reading should be integrated with all other clnssroom activities. 
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27. AchievGiDcnt tccts ara good diagnostic instruments. 

28. Reading in^tru^tionc should focun more cn reconstructing meaning 
from the written page than pronouncing words. 

29. Low socio-econonic level and physical hindrances account for most 
reading problrms. 

30. If teachers would follow basal reader procedures with every student, 
more students v:ould learn to read. 

31. The quality of instruction in 3ower reading groups shoulc compensate 
for what you nay to a student when you put him in the Jowc^r group. 

32. To compensate for poor teaching methods^ teachers often 5pcnd too 
much time teaching reading, 

33. One responsibi] ity of the primary reading teacher is to expose students 

to different kinds of experiences. 

• * 

34. Teachers only need to diagnose student needs in the fall of the year. 

35. The emphasis given phonics changes according to student nee s. 

36. It Is more important to teach students tho meaning of new words than 
to tca^h them new uses for words already in their vocabulary* 
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ITEM B 



Appalachian Education Satellite Project 
Resource Coordinating Center 
Evnluation Component 
306 Frazoe Hall, University of Kentucky 
Lexington, Kentucky 40506 



TEACHHR ATTITUDES TOUTIRD CAREER EDUCATION (TACE) 



Instructions 

Mark all answers on the separate answer sheet — do not write on the 
test itr>elf . In the blank after the word "Test" at the top of the answer 
sheet write the abbreviated n.-une of the test . In the section "Student 
Number" in the lower riqht-nand corner writo y our 4-diqit fituc^ent number 
in the firs" four boxc^. ri acc a heavy horizontal }}nct in the appropriate 
space in the column undor i-^ach dj ait your student nximbcr. 

Indicate yoor anr.wers to the items by placing a heavy vomica] line 
in the column bciiide the appropriate item number on the separate answer 
sheet • Be sure the item number on the answer sheet matches the item number 
on the test, 

Mark ; 9) if you strongly agree with the statement 

4) if you moderately agree 

3) if you feel neutral 

2) if you moderately disagree 

1) if you strongly disagree 

Use a soft*] cad (tf2) pencil to mark the answer sheet — do not use 
a pen'or ball-point:- Be sure your mark fills the entire block of the response 
you wish to make. If you change your mind or make a mistake, be sure that 
you^ erase conple tc! y . Do not make any other marks on the answer sheet* 

Please ansuvr as truthfully as possible. Your answers do not aff-ici 
your grade in the course, but help us to assess the effectiveness of tho 
course and suggert improvements. 

1. The school program should include career development. 

2. Career education should be a continuous, life-long process* 

3. Infonnation about careers should be integrated with school curriculum. 

4* The community is .^n excellent resource to use in a career education 
program. 

5* I am willing to take the time to find community resources for a career 
education program. 
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6p Teaching plans should be organized around what people do in their 
occupations* 

7. 1 consider what people do in their occupations wlien I organize my 
teaching plans. 

8. A ccmmitmcnt fron the school administration is necessary for a success- 
ful Career education program. 

9. Schools have the responsibility to help students develop career 
cbjcctivcs 

10. Students should have experience in the world of work before leaving 
school . 

11. The school curriculum should be related to the career goals of the 
student. 

12. Tarcntr, r.houlrl be aware of career education cxporicnces occurring in 
the school syston. 

13* Helping children develop ocrupational awareness should be emphasized 
from kindergarten through grade six. 

14. Children In clcir.cntary 5;cr*ool are too young to start thinking about 
career* po: sibili tie^;. 

15. The school guidance personnel chould have responsibility for career 
education . 

16. The clar.r.room teacher should be rC5;ponr.ible for career education. 

17. Career oducit ion 5 ?s vu;t Another fod th.it will '^ij'^'*" be forgott^jn. 

18. Career education will help students make realistic career choices. 

19. Students nhould be prrmitted to miss regular classes in order to go on 
field tripn, 

20. It is important for children to bo taught a work ethic. 

21. 1 feel that career education should bo included in the curric'iiuTn 
experiences of each child, 

22. A commitment from the classroom teacher is needed for a successful 
career education program. 

23. I am aware of what my colleagues are doing In the area of career education, 

24. I help L\y students develop occupational av/areness through the use of 
film strips, field trips, and speakers. 
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25. I have discur.scd at length career education procedures with my 
colleagues. 

26. Subject matter lesson plans should include career information. 

27. I consider '^oh awareness when devising my lesson "^ilv.ns. 

28. An olenentary toachcr should Know thft community employment reeds. 

29. Enough emphasis is aliracly placed on career education in the schools, 

30* Career education in the elementary school is futile since a person wi 
change hin mind several tines before picking a lifetime career. 
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ITEM C 



Appalachian Education Satellite Project 
Resource Coordinating Conter 
Evaluation Component 
306 Frazee Hall^ University of Kentucky 
Lexington, Kentucky 40506 



TEACHING PRACTICES INVENTORY: READING (TPRI) 
Student Number 



The qv!estions below concern what you did last year (1973-74 school 
year). Please answer questions to the best of your ability. No good or 
bad evaluation of your activities will be made. It is important that the 
Evaluation Staff of AESP learns how you approached the teaching of Reading 
la*»t year, so that next year, after you have conpleted the course, we can 
see what changes have taken place in your teaching methods. 

If you are a counselor or principal attempt to answer all. questions. 
However feel free to leave blank any that could not apply to your activities 
last year* 

Please turn in tht completed survey to the site monitor at the next 
class meeting. This is simply the easiest way for the Evaluation Section 
to receive your comments. 

Do not write your name on this inventory* At the first meeting you 
will be told your student nunOoer. Pleace write that number in the space 
above. 



1, Lamt year (1973-74) how did you organize your reading 
instruction? Select one from the following 

( ) all children road the same materials at the same time 

( ) all children read the same materials at their own rates 

( ) children were allowed to select their own reading mate:.'ials 

from the library, reading kits, or texts 
( ) children were assigned reading materials based on skill 

weaknesses 

2* Did your students work in groups in class where everybody in 

a group was on about the same reading level? Yes No 

3. Did your students work in groups based on common skill 

weaknesses? Yes No 

4. Were students assigned to a different teacher according to 
their reading levels (i.e. you had all the children i>n one 

levels and another teacher had the children on another)? Yes No 

5. Did you work individually with every student to plan their 

reading programs? Yes No 
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6* How would you categorize the approach to reading you used? 

( ) phonics 

( ) patterning 

( ) language cxrcrienco 

( ) basal reader 

( ) prescriptive instruction 

( ) other (list) 



7. Which approach do you use to teach first graders reading? 

( ) teach phonics 

( ) teach some basic sight words 

( ) read stories and use pictures to stimulate interest 
( ) give a reading rcadincsK test and proceed according 

to the students scores 
( ) other (list) 



In order to supplenent your reading lesson what did you 
(check those that apply) 

( ) basal series 

( ) library books 

( ) linguistic kits and materials 

( ) workbooks 

( ) tape recorders, phonographs and other audio-visual 

equipment 

( ) retrieval systems 

( ) other (list) 



9. Last year did you ever analyz your student's oral rcudino 
miscues? ' 

Yes No 

10. Which one of the following describes the purpose for which 
you used Oral Reading Miscue Analysis with your class? 

( ) to determine reading levels, reading interests, and 

word-recognition skills 
( ) to see how well students read in relation to other students 
( . to determine if students were deficient in specific 

reading skills 
( ) to discover each child's reading strategies 

11. Did you use any Standardized Reading Tests last year? Yes No 
If so, plcasr list the names of those tcrts. 
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12. Which one of the following bo9t describos the purpose for which 
you used Standardized heading Tests with your students? 

( ) to deteiTaino reading levels, reading interests, and word" 

recognition skills 
( ) to see how v.vll student*; read in relation to other students 
( ) to determine if students weic deficient in specific 

reading skills 
( ) to discover each chi]d*s reading st^-ategies 

13. Did you use Informal Reading Tests with your students last 

year? Yes No 

14. Which one of the following best describes the purpose for which 
you used Informol Reading Tests with your students? 

( ) to determine reading level, reading interests, and word^ 

recognition skills 
{ ) to see hov; well students read in relation to other students 
( ) to determine if studcntr, v/ere deficient jn specific 

reading skills 
( ) to discover each chiM's reading strategies 

15. Did you use any Reading Skills Tests in your class last year? Yes No 

16» Which one of the following best describes the purpose for which 
you -used Reading Skills Tests with your students? 

( ) to determine reading Icvo.l, reading interests, and word- 
recognition f;kil!! c 

( ) to see how well studontF road in relation to other students 

( ) to determine if student r- v/erc deficient in specific 
reading Fkills 

( ) to discover each child's reading strategics 



17. Did you find standardized tests useful to your teaching 

procedure? y^g 



le. 



Have you taught in (select as many as apply) 

) team teaching situations 

) open concept classrooms 

) traditional classrooms 

) resource center 

) individual instruction situations 

) homogeneous classrooms 

) none of the above 

) other (list) 



No 



. During classroom work periods the noise level in your room was 
( ) completely quiet 

( ) whisper noise caused by students working together 
( ) fairly high amount of noise caused by enthusiasm and 

group involvement 
( ) fairly higli since many of the students were not interested in 

learning 
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20. Were parents very involved in your school programs last year? Yes 

21. Students an your school^ on the whole 

( ) were interested and enthusiastic about school 

( ) were nildly intcrcst'Cd 

( ) did not appear interested, but did their school work 

( ) seemed to be only passing time of day 

( ) disliked school 

22. Did you carefully define whaL you expected from your students 
and write down those expectations in the form of objectives? Yes 

23. The teaching strategics you used most were (check as many as 
apply) 

( ) teaching small groups 
( ) teaching large groups 
( ) teaching an individual 

( ) urjing a lesson plan developed by someone else 
( ) developing your own lesson plan 

24. Did you encourage students to help each other in the class- 
room? Yes 

25. Did you have students tutor other students? Yes 

26. In working with small groups which technique did you use 

most? 



( ) lecturing 

( ) £:crvinq as a resource person 

( ) do both ab.-)ut roually 

( ) other (list) ' 



27. What v/ere the majority of your lessons based on? 

( ) a state prepared les?;on plan 

( ) a systom-widc lesson plan 

( ) a coruTiOrcially developed lesson plan 

( ) a rchool-widc lesson plan 

( ) a lesson plan developed by yourself 

28. Did you have a budget for classroom supplies and materials? Yes 

29. Did you order supplies and materials for your class? Yes 

30. Are you of the opinion that your school had satisfactory 
supplies / equipment and materials? yes 

31. Did your classroom equipment include 

( ) a television ( ) over-head projector 

( ) tape recorder ( ) none of the above 

( ) phonograph 
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32, In which of tho following areas did you feel that your school 
needed additional staff mcrnbcrs? 

( ) administrative 

( ) supervisory 

( ) counseling and guidance 

( ) classroom teachers 

( ) clerical - teachers aids 

( ) other (list) 



33. About how many books did your school have in its library? 

( ) less than 300 ( ) 2001 - 3000 

( ) 301 - 1000 ( ) 3001 " 5000 

( ) 1001 - 2000 { ) over 5000 

34 . Did the guidance counselor supply you with materials 

which helped to strengthen your instructional program? Yes No 

35. Did the State Department of Instruction have available 

materials which you found useful? Yas No 

36. Are you familiar with the ERIC microfiche system? Yes No 

37. Do yoir know the location of an ERIC Reader in your vicinity? ' es No 

38. Have you had any input into the curriculum which you teach? Yes No 

39. Did your principal cr supervisors encourage v^u to experiment 

with different instructional styles or techniques? Yes No 

40. Di<3 students have any input to your curriculum development? Yes No 

41. Did you take part in curriculum development committees? Yes No 

42. When faced with an instruction problem, what did you do? 
(check as many as apply) 

) sought the help of guidance counselor 
)• sought the help of fellow teacher 
) sought the help of principal 
) sought the help of area supervisor 
) solved the problem by yourself 

43. Did you see a need for a revision of your curriculum in your 

school system but were rot able to help in its revision? Yes No 

44. Did you see a need for a revision of your curriculum in your 

school system and were able to help in its revision? Yes No 

45. Did you see a need for a curriculum revision in your school 

system? 

46* Did you feel that you had a sufficient amount of time during 

the day to prepare your lessons? Yes ^ No 
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47. Through which of tho following activities did you share your 
teaching idcar. with your fellow teachers? 

( ) informal discussions 

( ) as a Icador of an in-service teacher training program 

( ) as a participcint in an in-service teacher training program 

( ) as a coordinator of a curriculum development project 

( ) as a participant in a curriculum development project 

{ ) other (list) __„^ 



48* If you checked one or more activities in item 47, check below 
the area or areas towards which those activities were aimed. 

( ) Career Education 

( ) Reading 

( ) Mathematics 

( ) Language Skills 

( ) Social Stuuie:^ 

( ) other (list) 



49* Were there factors that inhibited you from carrying out some project 
or curriculum revision? If so, check as many below as apply. 

( ) lack of self-confidence 

C ) lack of knowledge and skills 

( ) lack of adninistrativc support 

( ) Jack of i\">ncy 

( ) lack of resources 

( ) lack of fellow teacher support 

( ) lack of timo 

( ) other (li£.t) 



50. Were there factors that encouraged you to initiate and carry through 
a project or curriculum revision? If so, check as many below 
as apply. 

( ) confidence in self 

( ) sufficient knowledge and skills 

( ) adequate administrative support 

( ) adequate money 

( ) adequate resources 

( ) adcquc\tc fellow teacher support 

( ) sufficient time 

( ) other (list) 
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ITEM D 



Appalachian Education Satellite Project 
Resource Coordinating Center 
Evaluation Component 
306 Frazee Hall, University of Kentucky 
Lexington, Kentucky 40506 



TEACHING rRA':TICES TNVEtJTORY: CAREER EDUCATION (TPIC) 



Student Number 



Tha questions below concern what you did last year (1973-74 school 
year)* Please answer questions to the best of your ability* No good or 
^ac^ evaluation of your activities will be made. It is important that the 
>ivaluation Staff of ALSP learns how you approached the teaching of Career 
Education last year, so that ne?:t yoar, after you have completed the course, 
we can see what chanqcs have taken place in your teaching methods. 

If you are a counselor or principal attempt to answer all questions. 
However feel free to leave blank any that could not apply to your activities 
last year. 

Ple^ise turn in the completed survey to the site monitor at ♦■he next 
class meeting* This is simply the easiest way for the Evaluation Section 
to eceive your coirimcnts. 

Do noc write your name on this inventory. At the first meeting you 
will be toli your studont num}>cr* Please write that number in the space 
above. 



With regard to lai^t year (1973-74 school year) 

1. Was there a functioning Career Education program in your 

scliool? Yes No 

2* Was there a Career Education program in your school and 

your class was involved in the program? No 

3. Was time taVen in your class to do Career Education 

activities? Yes No 

4. No time was takon in classroon* for specific Career Education 
activities, however Career Education was incorporated with 

other parts of curriculum. Yes No 

5. The person (a) who had the most responsibility in devising a 
Car .*er Education program in your school was 



( ) guidance couns^elor 

( ) teach<!rs 

( ) principal 

( ) all the above 

( ) none of the above 
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6. Did your school principal discuss Career Education programs 

with you7 yes No 

7. Which of the following techniques did you use last year? 
(check as many as apply) 

( ) explain to students that each person sees a job 
differently 

< ) have students pick an occupation and tell what it means 

and then compare answers 
( ) use community employees as speakers 
( ) introduce various types of jol^i" to students 
( ) ask students v^hat they would like to do when they grow up 
( ) ask students what their fathers do for a living 
( ) help students to see themselves as worthwhile individuals 
( ) role playing of various jobs 
( ) outside speakers explaining their jobs 

( ) have children's parents serve as resources for information 
about careers 

( ) have students make a chart of your community needs and 

the occupations that fulfill those needs 
( ) have students write essays on what life wouj^d be like 

without certain jobs 
( ) have students list all jobs they can think of 
( ) explain educational requirements of jobs 
( ) have students explore the types of educational skills 

'needed for jobs in which they are interested 
( ) explain what jobs use the educational skills you are 

teaching 

( ) have students use educational skills in simulated jobs 
( ) others (list) 



8* Did you find the concept that individuals differ in their 
Interests, abilities, and values was important to Career 
Education? 



Yea No 



9. Did you find that hobbies were a good source of Career 

Education information? yes No 

10. Did you feel comfortable doing Career Education projects in 

the classroom? 

11. The best outside sources for Career Education materials are? 
(please rank 1-best to 5-worst) 

( ) books and pamphlets 

( ) Career Education kits 

( ) films and fllmstrips 

( ) records and t<ipec 

( ) other(s) (list) 
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X2. In order co gain information about Career Education which of the 
following did you rely on? (check all that apply) 

( ) regional Career Education center 

{ ) school systen Career Education center 

( ) school Career rducation center 

( ) guidance counselor 

{ ) school principal 

( ) local industries 

( ) local library 

{ ) profossionol books and journals 

( ) college library 

( ) college ptofossnrs 

{ ) rctriov.'.l syrtcm 

( ) other (list) 



13. Did you use movies and filmstrips concerning Career 

Education in your classroom? yes No 

14* Do you know where to obtain movies and filmstrips concerning 

Career Education? Y0s 

15. It appeared that the student's parents wanted Career 

Education taught in this community. Yes No 

16. Did your school system have inservice sessions concerning 

Career Education techniques? Yes No 

17. Did you find stAndrircVizcd tests useful to your teaching 
procedure? Y^3 

18. Have you taught in (select as mnny as apply) 

) team teaching situations 

) open concept clnssrooms 

) traditional classrooms 

) resource center 

) individual instruction situations 

) homogeneous classrooms 

) none of the above 

) other (list) 



During classroom work periods the noise level in your room 
was 

( ) completely quiet 

( ) whisper noiFc caused by students working together 
( ) fairly high amount of noise caused by enthusiasm and 

group involvement 
( ) fairly high since runny of the students were not 

interested in learning 
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20. v;erc parents very involvee in your school progr^ir.^s Idst ycor? Yes 

21. Student? in your school^ on the whole 

( ) were iritcrostcd find enthusiastic about school 

{ ) were nildly interested 

( ) did nc*t jproar intereiited, l>ut did their school work 

( ) rtiC'H'jd to be only passing tine of day 

( J difilikcd LChocl 

22. Did you carefully dvfin'^ what you e:>:pected fron your students 
and \ ito down thorc expectations in the Tom of objectives? Yes 

23. The teaching stratoqie.s you uccd moct were (check as many as 
apply) 

( ) teach ino rmall croups 
( ) toac3ur.^7 laiqo groups 
( ) ttacliing an individual 

( ) usiny a lascon plan developed by someone eliic 
( ) developing your own lesson plan 
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Did you encourage students to help each other in the class- 
room? 



Yes 



25. Did you have studcnws tutor other students? yes 

26. In working wich small groups which technique did you use 
most? 

( ) ]ecturir<j 

( ) sorvina a rcrcurcc person 
( ) Co J:oth about ccrually 
( ) oLhcjr (list) 



27. What wore the majority of your Icssonc based on? 

( ) a state prepared lesron plan 

( ) a f.yctcm-wide Ic-.sion plan 

( ) a ccrjnoicially enveloped Icsr^on plar. 

( ) a school *\v'id:2 l^ rscn plan 

( ) a loBccn plan developed by yourself 

28. Did you have iK budget for classroon supplies end materials? Yes 

29. Did you order supplier; and materials for your class? Yes 

30. hrc you of the opinion that vr»ur pchool lijid ratisfnrtory 
supplier*, eqai potent cind material s? 

31. Did your clasnrcom cnuipnnnt incltido 

( ) a ttOLvi'oion ( ) ovcr-hoar' j roj»:c^.or 

( ) tape iL-C'^rder ( ) no.;^ of the aLcvo 

( ) f'hoiio^^r.i.'f. 
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In which of the fo] lowing azoas did you foe! that your school 
noodod additional staff members? 

( ) adrornistrativw 

( ) supcrvirory 

( ) couDDclinc and guidance 

( ) claE5;rooM teachers 

( ) clerical - teacher:" aids 

( ) other diet) 



No 



33. About how nicsny books did your school have in its library? 

( ) less then :O0 ( ) 2001 * 300G 

( ) 301 - 1000 ( ) 3001 - 5000 

( ) 1001 - 2000 ( ) over 1000 

34. Did the guidance counselor supply you with materials 
vhich hcipcd to ^tn-ncjUion your instructional profrram? yes 

35. Did the Ftatc r^c: ; rent of Inr^trr.ction have available 
materials v/hich you found useful? 

36. Arc you faniliar with the EHTC microfiche systen;? yes No 

37. Do yQu know the location of an FRTC Roodor in your vicinity? yes «^o 

38. Have you had any input into the cnrriculun which you tor^ch? Yes r:o 

39. D^ : ynur . : .vj : ivti or ruy^crvj r.oi;^ cncouraoc ^'cu tc cxnc*-'nert 

With different iniitruwtionr.l stylos or ^.->cll^'iqucs? ' * ' yes iJo 

40. Did slu^V^nt.'. Jic.vc nry input to your curriculum c rvolo:r.ont? 



Yc: 



No 



41. Did you take ^art in cMiriculum devolorrr.cnt committees? yes 

42. v:hcn fac-d with instruction problem, wha* did you do? 
(chock as many at apply) 

( ) souqht the help of qui.lnncc councolor 

( )' fiouqht the help of fellow teacher 

( ) souoht thD help of pri'-.cin.-il 

( ) souyht the holp ot area lui orvisor 

( ) solved the problem by yo'jri^olf 

43. Did you see a uocC for a r^'vit^jon of your curriculum in your 

school systen; but vcre not whlc to help in its revisic^n? Yes Vo 

44. Did you see a nc-n for a revision ot your curriculum in your 

school fi-sten 6nd were able to h:flp in itf. rc,:ricn? Yes No 

45. Did you rro ^ m-oa for a cui- icul-jir. revis.^c^i jn vour school 

^y^'^^^ ' Yes _ !:o 

46. Did you fee? Iha had a s.ffi^:cnt anourt of time during 



the 6^y tr> f r-,uc yuar l">:;rons? Vp,, 
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47. Through wh^ch of tJio follc\'\ng activities did you rhr>ro your 
tCAchirg iclcci!: with your fellow teachers? 

( ) ii;formj!l discussions 

( ) as a leader oC an in-scrvico toachL:r tra:.ning procram 

( ) as a participant in an in-rorvj cc tcnchcr training progra^n 

( ) as a coordinator of a curriculum dc.vc3oj;mrnt project 

( ) as a piiiticii.ant in a curriculum development project. 

( ) other (list) 



48. If you chcched one or more activities in item 47, check below 
the area or areas .tovards v/hich thottj activities wore aimed. 

( > CuV *er r iucation 

( ) Koad? ng 

( ) l!athciratj cs 

( ) L^-ncjuooi D.ills 

( ) Social iJtudics 

( ) other (xir.t) 



49. Were there factors tliat inhibited you from carrying out some propoct 
or curriculum revision? If so, check as many celow r.s apoly. 

( ) lack of rclf-oonf idcr.cc 

( ) Jt.ck of ki;o;lcdcr and ckills 

( ) lack of r*cuniristrr.f.ivtj supf-or^ 

( ) Ic^cK r>r I cn^^y 

( ) J<icK of It ■'^^ 

( ) l.ic:}. ct foJlf '.v- toach?r uui.j^ort 

( ) Irck of i Lmo 

( ) other (livV) 



50. Were there factors that <^ncourag^d you to initiate and carry through 
a project or rr.rricuJan revision? If co, chock as it^-i-.v below 
as i^.pply. 

( ) confid^jncc in self 

( ) suffjcicnt knowledge and skills 

( ) adequate adriinictrati vo support 

( ) adequate nonc*y 

( ) adequate rc^^ources 

( ) adequate fellow tp.icher sui>port 

( ) sufficient tine 

( ) other (lir>t) 



Ai:sr/i:v;^/G/rV/4/rt 



57 



B£SI COM ftVWlABLE 



ITEM E 



Appaliichian Education Satellite Project 
Resource Coordinating Center 
Evaluation Comtoncnt 
306 Fr-izee Hall, University of Kentucky 
Lexington, Kentuc):y 40506 



TELEVISED LECTURE QUESTIONNAIRE (TLQ) 



Instruction s , 

Check to nake sure yo ur student nvimber appears in the first four 
boxes in the section labeled "Student Number" in the lower rioht-hand 
corner of the separate ansvxr sheet* If it does not , make sure you have 
the packet 1^4b<.icd with your student nmaber. If you have the right packet* 
then erase the incorrect nurhcr and write in your correct student nisnber. 
You also need to erase the incorrect boxrs under the nvurljer and mark in 
the right boxes* 

Che ck to make sure the letters after the word "Test" are the same 
as the abbreviated n an^e _ of th e fo rm you arc using. This abbreviation is 
found in the parentheses immediately following the instrument name* 

If they do not natch, rheck through your packet to see if the answer 
sheets for this form are in the packet. If the proper matching answer 
sheet is not there, cross out the wrong name ( do not eri.se) and write in 
the correct Ahbrcvi^ircd nnrc. If it ir> cro;^r:od out, \:v }:nc;; to chancre the 
coding. 

Ma rk all uncwors on the ^<^^^5^ tc avr^w c r rh^et * Indicate your answers 
by rlr.cinq h v;vy v- rirc .1 tl;^ ccii/ j; i. c^sictc the expropriate item 

number on the s<;paratc answer chcct. Be sure the item number on the answer 
sheet matches the item number on the test. 

Mark: 5) if you strongly agree with the statement 

4) if you moderately agree 

3) if you feci neutra] 



2) if you modrratcly disagree 
1) if you strongly disagree 



Use a r.oft-Icad (f^2) pencil to mark tne answer sheet — do not use 
a pen or ball-|^oint* Dc .sure your mark fills the entire block of the 
rcsj>on5c you wish to make. If you change your trind or make a m,* stake, 
be sum that you erase coT.iplotoly . Do not make any other marks on the 
answer sheet. 
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Please an£wpr as truthfully as possible. Your answers do not affect 
your grado in the course, but help us to arsess the effectiveness of the 
televised lecture and suggest improvements, 

Ip The TV viewing conditicns in the room were unsatisfactory, 

2. I frequently hai difficulty seeing the materials presented on 

3. I frequently had difficulty hearing what the TV instructor said 
because he spoke too quietly. 

4* I had difficulty seeing the TV. 

5. The program held my attention all the time, 

6. The TV instructor clearly identified what the unit wouia cover. 

7. Adequate transition between ideas was provided. 

8. I feel I learned a great deal from this TV program. 

9. The charts and pictures used in the TV program did not help me 
understand the suJbject better* 

10. The TV instructor organized his content weir. 

11- The TV instructor related the instructional material to easily under- 
standable cxar^plcs. 

12. T4ie TV instructor kept digressing to unimportant details, 

13. The TV instructor generally presented the material in a too complex 
manner. 

14. The TV in-;tructor generally presented the material in an over- 
simplified manner. 

15. The TV instructor generally showed enthusiasm for, and interest in, 
his subject. 

16* 'iJhat I learned during the televised lectur e will be useful to r - 
as a classroom teacher. 

17. To the best of my knowledge the information in the televised lecture 
was correct. 

18. The TV instructor normally took enough time to clarify one aspect 
of the :#ubjcct before moving into the next# 
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19. 
20. 
21, 
22. 
23. 
24. 
25. 
26. 

27. 



The TV instructor Lpoke clearly and distinctly. 

The material presented was too difficult. 

The material prcr5cnte<? was too simple. 

The TV instructor did not speak in a monotone. 

The TV instructor spoke in a condescending manner. 

The picture was dirtcrrted. 

The program covered too much material. 

I v:ould ]ike to use the materials and procedures introduced during 
the televised lecture in my classroon. 

The lecture dealt with a sxjbjcct fundamental to the course. 
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ITEM F 



Appalachian Education Satellite Project 
Resource Coordinating Center 
Evaluation Component 
306 Fraroe Hall^ University of Kentucky 
Lexington r Kentucky 40506 



SEI-IINAR QUESTIONNAIRE (SQ) 



Chfick to make sure your student number appears in the first four 
boxes in the section Jabelca •*stuclent Nuraber*' in the lower right-hand cor- 
ner of the separate ansv/cr sheet. If it does not , make sure you have the 
packet labeled v/ith your student number* If you have the right packet, 
then erase thn incorrect number and write in your correct student number. 
You also need to erase the incorrect boxes under the number and mark in 
the right boxes. 

Check to make sure the letters after the word "Test" are the sane 
as the abbreviated name of the foi-ni you are using . This abbreviation is 
found in the parentheses immediately following the instrument name. 

If they do not match, check through your packet to see if the an- 
swer sheets for this form are in the packet. If the proper matching an- 
swer sheet is not there, cross out the wrong nane (do not erase) and 
write in the correct abbreviated name. If it is crossed out, we know to 
change the codii.g* 

M^rk all answers on the rcnarate ansv;Gr shoet . Indicate your an- 
swers by g^lacinn a heavy verticil linn in the column hoside the appropri- 
ate itom number on the separate ausv;er sheet. Be sure the item number on 
the answer shcot matches the item nuni^er on the test. 

Karkx S) if you strongly agree with the statement 

4) if you moderately agree 

3) if you feel neutral 

2) if yea moderately disagree 

1) if you strongly disagree 

U se a soft-lead (#2) pencil to mark the answer sheet do not use 
a pen or ball-pointp Be sure* your mark fills the entire block of the re- 
sponac you wish to make. If you change your mir.d or make a mistake, be 
sure that you erase completely . Do not make any other marks on the an- 
6W3r sheet. 

Please answer as truthfully as possible. Your answers do not af- 
fect your grade in the course, but holp us to assess the effectiveness of 
th^ live seminar and suggest improvements. 



1 
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1* The pre-taped films presented during the semineu: were a valuable sup- 
plement to material previously presented in the course* 

2« The seminar presenters did not provide adequate responses to the 
questions generated by course participants. 

3. The questions sent in by course participants were valuable in high- 
lightxng important issues. 

4. Many important questions regarding the seminar topic were not raised* 

5. I was not given sufficient opportunity to contribute questions for 
the seminar, 

6. There was adequate time allowed for the preparation and transmission 
of questions for the seminar presenters. 

7. The seminar discussion was interesting. 

8. The seminar presentation was not well organized, 

9. The seminar discussants expressed themselves clearly. 

10. The seminar presenters were obviously quite expert in the content 
areas discussed. 

11. The seminar helped me to understand better what this course is all 
about. 

12. The televised seminAr d ocs not compare very favorably to an on**site 
seminar with actual student participation. 

13. I got more out of tne seminar presentation than one of the thirty 
minute prctaped lessons. 

14. No really ncv; material was introduced during the seminar. 

15. I feel that having the opportunity to generate and receive answers to 
questions was the most valuable aspect of the seminrr. 

16. The time allowed for the seminar was too short . 

17. This was not a good time in the course sequence to discuss the ^aaterial 
covered in the seminar. 

18. 1 wish more of the televised lessons were seminars. 

19. I feel that the scirinar presenters were not really aware of actual 
classroom and community problems. 

20. I do not have a good grasp of the new material introduced during the seminar. 

21. The filmed sections of the seminar were better than the discussion sections. 
AESP/EVAL/6/2 1/74/pb 
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ITEM G 



Appalachian Education Satellite Project 
Resource Coordinating Cnnter 
Evaluation Component 
306 Frazce Hall * University of Kentucky 
Lexington, Kentucky 40506 



USER FOUR-CIIANNEr, AUDIO RATING FORM (UFCA) 



Student Nuirber ' Date 



Check to nake sure your student nuinber appe?.rs in the first four 
boxes in the section labeled "Student Nunber" in the lower right-hand 
corner of the separate answer sheet. If it does not ^ make sure you have 
the packet labeled with your student number* If you have the right packet, 
then erase the incorrect nuinber and write in yotir correct student number. 
You also need to erase the incorrect boxes under the nuinber and mark in the 
right boxes. 

Chec?1c to make sure the letters after the word "Test" are the same 
as the abbreviated name of^ th^_ form you are using. This abbreviation is 
found in the parentheses immediately following the instrument name. 

If they dc not match, check through your packet to see if the 
answer sheets for th.is form are in the packet. If the proper matching 
answer sheet is not there, cro?s out the wronq nj" c (i?.o not erase) and 
write in the correct abbreviated nan.c. If it it crossed out, we know to 
change the coding. 

Mark all answers on the separate answer phcct . Indicate your answers 
by placing a heavy vertical line in the colxjmn beside the appropriate item 
number on the separate answer sheet. Be sure the item number on the answer 
sheet matches the item nu^iber on the test. 

Mark: 5) if you strongly agree with the statement 

4) if you moderately agree 

3) if you feel neutral 

2) if you moderately disagree 

I) if you strongly disagree 

Vf^c soft-lead (^2) pencil to mark the answer sheet — do not use 
a pen or ball- point. Dc sure your mark fills the entire block of the response 
you wish to ntikc. If you change your mind or tfakc a mistake, be sure that 
you erase conrplctcly . Do not -^akc any other mark,^ on the answer sheet. 
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Peei rrcQ to add additional coinincnts about the quality of the four- 
channel audio irrt ruction undor 'conunents' below the statements. Your 
ratings help determine the quality and dcsirabliity of the four-channel 
audio method of instruction, Wliat you say does not affect your grade, and 
your instructor does not sec individual responses. 



Sound 

1. The volujoo was satisfactory • 

2. The voice quality was distorted by transmitted noiiies, 

3. I heard more than one answer at the sane time. 
Timing 

4. There was not sufficient time to put the head piece on before the first 
question began. 

5. There v/as adequate time to make each selection before the answer was 
given. 

6. The answers to questions were not finished when the next question began. 
Mechanics 

7. I did not receive the answers 1 selectrd. 

8. The equipment was hard to use. 

9. I enjoyed working with the four-channel audio equipr.ent. 
10. The speaker spoke too f^st* 

11 • The speaker spoke clearly. 
Content 

12. The material presented was not relevant to the unit topic. 

13. The questions and answers helped me understand better what wcz presented 
in the video, 

14. The qtientions and answers helped me understand how to use in the class- 
room the materials and procedures presented in the video. 

15. The explanations to the questions were clear. 

16. The explanations were thorough. 

17. The explanations were interesting. 
Comments: writo on back of this page* 
AESr/EVAL/G/^l/74/vr 
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ITEM H 



Appalachian Education Satellite Project 
Resource Coordinciting Unit 
Evaluation Coi»jponent 
306 Frazee Hall, University of Kentucky 
Lexington, Kentucky 4050G 



LABORATORIES ACTIVITIES OUESTIONNAIRE (LAQ) 



Instr uc tions 

Check to make sure your student number appears in the first 
four boxes in the section labeled "Student Number*' in the lower right- 
hand corner of the separate inswer sheet. If it does no c» make sure you 
have the packet labeled v;ith your student number. If you have the right 
packet, then crnse the incorrect number and write in your correct student 
number. You also need to ^rase the incorrect boxes under the nuniber and 
mark in the right boxes. 

Check to- make sure the letters after the word •'Test'* are the same 
as the abbreviated name of the form you are using. This abbreviation is 
found in the parentheses immediately following the instrument name. 

If they do not mate check through your packet to see if the answer 
sheets for this form are in the packet. If the proper rnatching answer 
sheet is not there, crosf^out the wrong name (do not erase) and write in the 
correct abbreviated nairc. If it is crossed out, we know to change the 
coding. 

Mark all answers on the s e pa rp.tc answer shoi^t * Indicate your answers 
by placing a hc^av v' vcrtic cil line in the column bccide the appropriate item 
nvRiber on the separate answer sheet. Be sure the item number on the answer 
sheet matches the item number on the test. 

Mark} 5) if you strongly agree with the statement 

4) if you moderately agree 

3) if you feel neutral 

2) if you moderately disagree 

1) if you strongly disagree 

Use a soft-lead (#2) pencil to mark the answer sheet do not use 
a pen or ball-point. Be sure your mark fills the entire block of the 
response you wish to make. If you change your mind or make a mistake # 
be sure that you erase completely . Do not make any other marks on the 
answer sheet. 

Please answer as truthfully as possible, your answers do not affect 
your grado in the course, but help us to assess the effectiveness of the 
laboratory activities and suggest improvements. 
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!• The video adequately prepared me for the laboratory activities, 

2. The instructions for the laboratory activities were clear. 

3. What 1 learned during the laboratory activities will be useful to 
me as a classroom teacher. 

4. The laboratory activities were more useful than the video tape lesson 
in demonstrating the practical use of concepts and procedures. 

5. The interaction with other class itvenibers during the laboratory session 
was helpful. 

6* The person in charge of the laboratory session was helpful. 

7^ The person in charge of the laboratory session gave adequate directions. 

B. The value of the laboratory session was that it provided an opportunity 
to handle the actual ma.terials discussed in the televised lecture* 

9. The laboratory session enables you to see the practical uses of the 
materials and procedures described in the televised lecture. 

10. I was able to successfully con^lete the laboratory activities. 

11. There was enough time to complete the laboratory activities* 

12. The laboratory session lasted too long. 

13. The laboratory activities were logically organized. 

14. Too much material was included in the laboratory session, 

15. Adequate explanation accompanied the laboratory activities. 

16. The purpose of the laboratory activities was clear to me. 

17. I would like to use the materials and procedures included in the 
lalDOratory session in my classroom* 

18. The classroom facilities provided were adequate for the classroom 
activities* 

19. It was easy to gr^t access to the materials needed to perform the 
laboratory activities. 

20. The laboratory activities were interesting. 

21. The laboratory activities helped me to understand the procedures 
presented iA the televised lecture better. 

22. The laboratory activities were more enjoyable than the video le^:son. 
AES?/EVAV^/2V74/jo 
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ITEM I 



Appalachian Education Satellite Project 
ResouroD Ooordinatlng Center 
Evaluation Cdfiponent 
306 Frazee Hall, university of Kentudc/ 
Lexington/ Ktentxicky 40506 



READING INFOFMATICN SYSTEM USER SATISFACTION QOESTICNNAIFS (RISUSQ) 



Instructicns: 

Mark all ansi.iers cn the separate anfswer sheet — do not write ai the 
test itself . In the blank after the wrd "School" at the top of the ansv^ 
sheet write thp nairc of the course you are taking. In the blank after the 
word "T^st" vTit -c tl-^ ax hrc viciz^<i narro of thn ^ P^^^- ^ ^® section labeled 
"Student Niiriber*'' located in the lover right-hand comer of the answer sheet r 
write yo^'ur 4-'dlgit stu do nt nurbor in the first four boxes. Plaoe a heavy 
horizontal line in the appropriate space in the colunn under each dicrit 
of your student nmber. 

Indicate your ansv^rs to the itens by placing a heavy vertical line 
in tte column hcsicie the a{-propriate item nuriser on the separate' anrwer 
sheet. Be sure the item niirber cn the answer sheet matches the itent nunter 
on the test* 

Mark ; 5) if you strongly agree with the statement 
4) if you moderately agree 

3) if you feel neutral \^ 
2) if you moderately disagree ^ , 

1) if you strongly disagree 

Use a scft-load (#2) pencil to mark the answer sheet — do not use 
a pien or ball-point. Ee sure your mark fills the entire block of the response 
you wish to irake* If you change your mind or make a mistake r be sure that 
you erase ootrplotely . Do not note any other marks on the answer shucL. 

Please answer as truthfully as possible. Your ansv^'ers do not affect 
your grade in the courser but help us to assess thj effectiveness of the 
course and suggest inprovements. 



1. Tbe Selfict-Bd training package adequately explained the use of 
this information system. 

2. Tte Texas Cotputer Retrieval System training package adequately 
explained the use of this information system, 

3. I feel that the information reqi^t form for the Select-Ed information 
system was clear in its format. 



4. I feel that the information request form for the Texas Oonputer 
Itetricval System infonration sj^stcfn was clear in its format. 

5t I fee] that it took too long to rooeive information fron the 
Selcct-na Ei'stan. 

6. I feel that it took too long to receive information fron the 
Tfexas Oorv^tcr Itetrieval Syston* 

7. The Sclect-Ed infomation search provided me with the informaticn 
I wanted* 

8. The Ttexas Ocrrputcr Itetrieval System informati.on search provided me 
with the inforratian I wanted. 

9. Hie Seloct-ra information system gave me more informatioi than I 
expectod, 

10. Ihe Tfexas Carputcr Kotricval System information system gave me 
more informatics than I expected. 

11. The Select-Ed information system was easy to use. 

12. Ihe Texas Ooqputcr Retrieval System information system was easy 
to use. 

13. The information received fron the SeJect-Ed information systejn 
was easy to interpret. 

14. The infcrr^tion xocciV'.xl frcm tho Texas Coi^utcr Patrieval System. 
inforTTi'^tion cyEtoT. \;as easy to interpret. 

15. The Scloct~Ed information system provided me with useful informatim. 

16. The T^as Caiputer I^etrieval Sysstem provided me with useful 
information. 

17. The Select-Fd information systcam is well worth the time and 
effort it took to use it. 

18. The Ttexas Ocirputer Retrieved System information system is well 
worth the time and effort it too): to use it# 

19. I received conflicting information from the different information 
sy stuns. 

20. If tho Select"Bd information system were available to me^ in n.y 
schcol system, I would use it. 

21. If tlie Ttexas OciT^>uter Retrieval System information system were 
available to to^ in my school system, I would use it. 

22. I feel that the Sclect-rd inforTration system is extremely 
beneficial to me as a teacher. 
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23* I feel that tte Tbxas Ccnputer Retrieval System information 
system is extxernely beneficial to me as a teadier, 

24. I would recoTfi^d the Select-Ed information system to ny 
fellow tcacl-vers. 

25. I vould recoTTOnd the Texas Oatputer Retrieval System informaticn 
system to my fellow teachers. 
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ITEM. J 



;\ppalachian Education Satellite Project 
Ifcsourcxs Coordinating Center 
Evaliiaticn Canpowent 
306 Fra7ee liall, University of KontucVr^ 
Lexington, Kentucky 40506 



CAREER rourATION 1NFX3!<:--^'T'IC1N SYPTC'-l USER EATISFACI'ION QUESTIO^IAIRE (CEISUSQ) 



Instructiotisj 

Mark all ansv.trE ai tho separate answer choet — do not vTit.e on the 
t est itFc lf. In tli= blr.nk a^tcr tJio word "Sdiool" at the top of ti'.o anE\-.or 
stectTT^" tho rr - ■r:_cf ^,ci c^vry^ yf^" trJunrj. In tJ^c hlZDk after the 
v.x)rd "•R?^~v.rir( V;~~" .- rc"V"\\.~i n-^-iv^ of ^^r* tor^t. In the rcction labeled 
"Ptudent ^:lt,>^?P'"-^c■ AC rTT^Tl" j.c-.-?r ric;''"it-ht nd cbri-^cr of the anf!\%'or sheet, 
wri<:o you r ^XV i'-i' v^'r:^ ijn the' first four bOMos. Flare a hc.a\^ 

lfj:::;;r^T.-;::y™|^^ , r,' , 5p?oo in tJic ccOAirr. unde r c^-ich digit 

of~i'a.u' :ituc'.:nt nu".'*. r. 

Iji dira tn your 'Z>r:v.T.r b J ^.-^ . itcirfi by p lnc-irg_a b. ^avy ver tical lire 
in tte'^urn bc-^ic:.' 'tlr"c!:.r'ic.!-.r.i.-tf-; it/aii nr-.'xr on f.c scpr'-rate cjisv.\3r 
shsct. Ee sure the item nun-.bcr on the ansvyier sheet matclies the item numlxr 
OP. the toct. 

Mark ; 5) if you strongly t.rjree witli tlie stateincnt 
4) if you inoderately agree 
3) if you feel neutral 

2) ii" V'^v nr-. -rntcV)' dii. agree 
1) if yovi t.trcngly di.sacjrec 

Us« a Eoft-lr.i-^ (i- 2) pencil to nvirk tJ:o answer sheet — do not use 
a pcn'^i^riCT=?^3~'a^"S^J?Jryoiir mark fills the entire block of the rcFoonc, 
vou wish to n.^.l;c'. IT y.'u cWrr-' ycTiir irdnd or r/i^:c a rdctake, he txvccj^v^^ 
vcu cra r>e cyi-»lGtc_l :t:.. rc no;; n-.il.c any other n^nrkft on the anr^.ver -^-oot. 

p]r.-a-.c ansv.-.^r ar, tiAithfully as possiMc.. Your anr.-:ers do r^t aifcct 
your gr.'/T -in the course, bvt h- Ip us to asFCES tlx; cf fcctivcjiess of the 
course and sugge st inprcArnrntr; . 

1. The ':ar,rMr:r B'sod FicEouroe addo trainirn package adequately 
esfplainc'cl the u£o of th:'.3 infonraticn tiyst^m. 

2. ThR EWC/AlM/;j<Il, nir:, CI.TC training package adequately explained 
the UF43 o*" this jxifomrt ion system. 

3. I fpcl th: t the infomvition '-eqivrt fo>in fc-r the Cc^utex Ba£cd 
pesoura Cuiu- infoiTivition rystrn v.-a:^ clear in ito fonnat. 
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4« I foel that the infonnatiai request form for the ERICVAIM/ARM, 
RX£, CUE information systifn was clear in its fomat. 

5^ I foel that it took too Iciig to receive information fron the 
Oarputcr Based Resource Guide system^ 

6. I feel that it took too long to receive informaticn fron the 
ERIC/Air/ARM, RIE, CIJE system, 

7. The Oxputer Based Resource Guide inforrrvatiGn search provided 
na with the inforrnation I wanted. 

8. The ERIC/AI^^/ARM# RIE^ CUE information search provided me with 
the information I wanted. 

9. The Ocnvuter Based Rf>souroe Guide information system gave me 
more inforrration than I e:<pected, 

10. Tfie ERIC/AINVV'Jr:, IKLE, CIJE informaticn system gave me more 
infontation than I expeci:ed. 

The Oorrputer Based Resouroe Guide information system was easy 
to use . 

12. The ERICA^^VAKM, RIE, CUE Information system was easy to use. 

13. Ihe infci^vation iirc^ived from the ODni>utcr Based Resouroe Guide 
informaticn system was ecisy to interpret. 

14. The information x-oceived from the ERIC/AI^'//^^ RIE, CIJE 
ijufomation system was easy to interpret, 

15. The Oonputer Based Resource Guide information system prc/ided 
me with tisoful inionraticn. 

16. The ERiq/AI!V'rJ?l, RIE, CIJE information systosn pirovided le with 
useful informaticn. 

17. The Ccuputer Based Resouroe Guide Informatics system is well worth 
the tijne and effort it tock to use it, 

18. The ERICAm/ARM, RIE, CIJE infonnation system is well worth the 
time and effort it took to use it* 

19. I received conflicting information from the different infonpation 
systems* 

20. If the Ocmputer Based Resource Guide information system vjore 
available to me, in ny school system, I v«uld use it, 

21. If the ERIcyAin/ARM, RIE, CIJE information system were available 
to me, in ny sdiool system^ I wuld use it. 

22. I feel that the Corputer Bcised rc^souroe Guido information system 
is extremely ber^^ficial to me as a teacher. 
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23. I feel that the ERIC/AlM/AFMr RIEr CUE information system is 
extixinely L)cneficial to as a teacher. 

24. I would rccoTiTcaid the Ocrputer Based Resource Guide information 
systtOT to rry fellow teachers* 

25. I would reccmtiend the ERIC/ATM/ARMf CIJE information system 
to my fcllov' teachers* 
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ITEM K 



Appalachian Education satellite Project 
Resource Coordinating Center 
Evaluation Component 
306 Frazee Hall, University of Kentucky 
Lexington, Kentucky 40S06 



INSTRUCTOR FEEDBACK QUESTIONNAIRE (IFQ) 



Instruct i ons 

Rate the following nine Instructional activities according to the 

quantity of useful infcrmation you received from each- Make your standard 

of reference an average, graduate education course. 

■ ■ 

1* Nark a 1 (^unacceptable) if you received a lot less information 
froio tha activity than you usually obtain from similar activities 
in a teacher preparation couise, 

2. Nark a 2 (poor) if you received somewhat less* 

3. Mark a 3 (average) if you received about the same aihv>ant from 
the activity* 

4* Mark a 4 (good) if you received a little mere from the activity 
than you usually obtain from similar activities in a graduate 
education course. 

5. Mark a 5 (outstanding) if you received a lot more from the 

activity than from a comparable activity in a graduate education 
courre. 

PJease answer as truthfully as possitle. Your answers do not affect 
your grade in the cc tree, but help us to assess the relative quality of the 
Instructional activiti-ss and suggest ways the learning sequence should be 
restructured. 

!• Fre-Proqram Preparation cdnpared to work usually assigned in other 
graduate classes prioi co covering material in class. 



S>:udent Number 



Course 



Date 



ttnaccpptable 



outstanding 



I 



1 



2 



3 



4 



5 



2. TV Program compared to a graduate Xectura. 

unacceptable outstanding 

I I I \ \ 1 

1 2 3 4 5 

Comments : 



3, Four-Channel Audio compared to class quizzes tolXowed by a discussion of 
the answers* 

unacceptable outstanding 

I I I I \ I 

1 2 3 4 5 

Comments : 



^* ^ciliary Activities compared to laboratory activities associated with 
other graduate courses* 

unacc«?ptable outstanding 

I I I ! \ I 

1 2 3 * 4 5 

Comments t 



5* On-site Re£er«;nco Materials compared to materials placed on reserve 

by other graduate instructors. 

unacceptable outstanding 

I I I I I I 



Comments t 



6. Retrieval Sybtcirs Matorials compared to materials instructors in other 
graduate courses locate to help specific individuals* 

unaccepLablo outstanding 

I \ I \ \ I 

12 3 4 5 

Conunent h : 



^ • Televirody Interact i^^t; Seminars compart*d to other graduate seniinars 
and class discussions* 

unacceptable outstanding 

I \ I \ I I 

1 2 3 4 5 

Comments : 



8. Follow-up Activities and homework assignments compared to similar 
activities in other graduate courses. 

unacceptable outstanding 

I I I I I I 

1 2 3 4 5 

Comments * 



9* Unit Tests compared to teacher-made unit tosts in other graduate 
courses • 

unacceptable outstanding 

L I ! \ \ J 

1 2 3 4 5 

Conments > 
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ITEM L 



Appalachian Education Satellite Project 
Resource Coordinating Center 
Evaluation Component 
306 Krasee Hall, University of Kentucky 
Lexington, Kentucky 40506 



STUDENT WITHDRAWAL FORM (SWF) 



Student Number Date 



Course 



Last date in class Number of classes f^ttended 

1. Did you find the sessions you attended beneficial? Yes No 

Comments 



2. v;ould you be Interestod in taking a similar course in the future? 
Yoc No 

3, V^'.iat were your reasons for withdrawing from th3 course? 



4. Do you have any suggeftiono of ways to Improve the course? 
Vcfl No Commer>ts 
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ITEM M 



Appalachian Education Satellite Project 
Resource Coordinating Center 

Evaluation Component 
306 Frazee Hall, University of Kentucky 

Lexington^ Kentucky 40506 



OBSERVATION LOG (OL) 



Location of Class^ 
Name of Observer 



Date 



I nstructions 

Ihe site coordinator and the cooperating faculty member fill in the 
observation log for all classes they observe. Theso on-site observations 
help the RCC plan more effective procedures. 



I. 



Rate the following 8 activities in each of the following 4 
categories. Using this 5*point scale ^ in the boy vrritei 

a 1, if the activity was genfsrally ex cel lent in that category; 

a 2> if the activity was e xcellen t at times ? 

a 3, if the activity was ac c**ptablo ? 

a 4, if the activity waj weak at times ; 

a 5, if tho activity was genera lly unacceptable * 



Content 



Qinlity of 
Prf.sentation 



Student 
Reaction 



Relation to 
other Unit 
Activities 



Check if 
Activity 
Unobserved 
Or Inapplicable 



First Tele- 
vision Proqram 


1 










First 4-Channel 
Audio 












Second Tele-" 
vision Prooram 












Second 4*Chr4nnel 
Audio 












Afternoon 
Seminar 












Ancillary 
Activities 












Unit Tests 












evaluation 
Forms 













XI. On the back of this form, explain any of your reactions or make 
any general comments you wish. 



ITEM N 



Appalachian Education Satellite Project 
K«source coordinating Center 
Evaluation Component 
306 Frazec Hall, University of Kentucky 
Lexin'^'ron, Kentucky 40506 



SUMNATIVE REPORT FORM (SRF) 



Name: Course: 



RESA: Slte(s)i 



Are you a site monitor? or consulting faculty? 

Instructions 

Using the Observation logs from each unit yo>: monitored or observed, supply 
the following information. Oo one SRF for each course you consulted for or 
monitored. Rate the ovorall quality of the following activities, in each 
of the four c^ "cgoriea * Using the following 5-point scale, place in the 
box I 

1 • if the activity was generally excellent in that category 

2 * if the activity was excellent at times 

3 - if the activity was acceptable 

4 - if the activity was weak at times 

5 - if the activity was generally unacceptable 







Content 


i 

Quality of 
! Presentfition 


Student 
Reaction 


Rc'lc.tion to 
other Unit 
1 Activities 


1. 


Televised i^ecture 




! 


1 



comment on your ratings and suggest improvements in the materials and 
procedures 
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2. 





Content 


Quality of 
Presentation 


Student 
Reaction 


Relation to 
other Unit 
Activities 


4-*^ChanneI audio review 











Commants and suggestions 



3. 



• 


Content 


Quality of 
Prefient^^tion 


Student 
Reaction 


Jkelation to; 
other Unit ; 
Activities ! 


Televised Seminars 











Contnents and suggestions 





Content 


Quality of 
Presentation 


Student 
Reaction 


Relation to 
other Unit ' 
Activities ' 


Laboratory Activities 











Comments and suggestions 



S3 
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Content 


puality of 
Presentation 


Student 
Ecoction 


Relation to \ 
other Unit 
Activities 


Unit Tests 











Comnents and tugO'-'Stionr. 





Content 


Quality of 
Presentation 


Student [ 'Relation to. 
Keactioni other Unit ! 
i Activities 


' — ■' 

Evaluation Torms 








1 



CommentB MiA Rugoostions 
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ITEM O 



Appalachian Education Satellite Project 
Resource Coordinating Center 
Evaluation Component 
306 Frazcc Hall, University of Kentucky 
Lexington, Kentucky 40506 



QUALITY OF T.V, RECEPTION (QTVR) 



Student Nu!rl>er Date 



Instruct ionfl 

Chock to make sure your student number appears in the first four 
boxes in the section labeled "Student Number" in the lower right*h^nd 
corner of the separate answer sheet. If it does not, make sure you have the 
packet labeled with your student number. If you have the right packet, then 
erase the incorrect number and write in your correct student nunbcir. You 
also need to erase the incorrect boxes under the number and mark in the 
right boxes* 

Check to make sure the letters after the word "Te$t'* are the same 
as the ai^breviated nair.o of the form you are using. This abbreviation is 
found in the parentheses immediately following the instrument name. 

If they do not match, check through your packet to see if the answer 
sheets for this forr^ arc in the packet. If the p-^H^^-'^" matching answer sheet 
is not thcrc^, cross out the wrong momc (do not eranc) and write in the 
correct abbreviated n.'jrte. If it is crossed out, wc know to change the coding. 

Hark all answers on the separate ansv^er sheet . Indicate your answers 
•by placing a heavy vertical line in the column beside the appropriate item 
number on the separate answer sheet. Be sure the item number on the answer 
sheet matches the item number on the test. 

Nark: 5) if you strongly agree with the statement 

4) if you moderately agree 

3) if you feel neutral 

2) if you moderately disagree 

1) if you strongly disagree 

Use a soft*lrad (#2) pencil to mark the answer sheet " do not use a 
pen or ball^-point. Be sure your mark fills the entire block of the response 
you wish to make. If you change your mind or make a mistake, be sure that 
you erase completely * Do not make any other marks on the Answer sheet. 
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PlcaF*? answer as truthfully as possible. Your ^^ncwcr8 do not affect 
your grade in the course, but let us knov the extent to which the infornation 
in the televised lecture rnd live seminars was available to you. 

Feel free to add additional cotnr.cnts about the quality of the reception 
under the "ccirar.onts" section brlcw the ?;tatcments. 

1. 1 could clearly hear the words spoken on the TV set. 

2. I had a hard time i. earing the audio portion due to poor reception, 

3. 1 had a hard time hearing the audio portion due to noises inside and 
outside the classroom. 

4. The scvind was never distorted. 

5. The sound never went otf during the progrion. 

6. There was picture on the TV set during the whole program. 
7* The picture was snowy. 

8. The picture was distorted. 

9. Tlie sound and the picture were synchronized. 

10* I was able to soc the program I was scheduled to receive. 
11* The color in ^.h^; i^icturri v/as of good quality. 
12. I wat satjsficd with the overall picture and sound quality. 
CoiTjrent s : 
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ITEM P 



/\ppalachic:n BducatiOT Satellite Projec^ 
R?rx>arce Coordinating CJenter 
Evciluation CcHSonent 
306 Fi-azcc Hall, Univprsity of Kentucky 
Lexington r Kentucky 40506 



IjyVRMING FACILITIES- DESCRIPTIOt^ (LTD) 



VESA 



Date 



SITE 



PrepariExJ by 



Instructions: Fill in at the beginnincy of each course and anytiJtte during 
the course the cUssroaa ir^ moved. This instrvOTcnt describes tJie facilities 
and identifies fEctors that affect learning. 



1. Size of television tube 
(neasured on the diagonal) 

2, Height o2 TV screen 

(measure frcr> the floor to center 
of TV picture tube) 

3# Type of Seating (select one) 

A. Chair 

B. Tablet Am Chair 

C. Desk ar.d Chair 

4* Spacing bctuxen seat ra^ 

(measured from tha back of one 
seat to the back of the seat 
in front of it.) 

5» Is there a color te3evision set 

6. ^ the sti:dcnts have an unobsti jctcd 
view of tlie TJ screer.? 

7. Are the scats staggered? 

P. Are thore several switches for 
adjusting lights? 

9. Is the classroan air ccnditicned? 

10. Are there rostroons near the classrocn? 

11. Is there a glare off the TV screen? 



ft. 



in. 



Id, 



check appropriate line 



ft. 



In. 



(circle one) 



yes 
yes 

yes 
yes 

yes 
yes 
yes 



no 
no 

no 
no 

no 
no 
no 
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•^•pical Clas!«room (Top View) 



width 




lcnguh*b 



Figure 1 



Referring to Fig. 1 plttase measure the Icnoth of the linc» indicated 
below in items 12-X7. 



12. a: 

13» b: 

14. c: 

15. d: 

16* et 

17. £: 



ft. 
ft. 
ft. 

ft. 

ft. 
ft. 



in. (vidtl^ of roaa) 
in, (lengtli of jXKkT.) 

in. (inaxijnjm vi<^ano distance: ±o distance 
bet^vecn tli2 f,a>nt of the IV i:ct w.d tiie 
back cf the .Vwathoiit viev/iiig sc^^lcnt) 

in. (ndninun vlei/in? distance: the distancx^ 
between the front of the TV set and the 
back of the clceest viewing student) 

in. (maxinun of f-oeriter viewing distanoe) 

in. (difitanoe betivcsri the bad^ of the farthest 
viewing student and the osidc of the most 
off-center viewing student) 



Using thef;e syntols ,C3,£3, 13 ) indicate ai Figure 1 the location of: 
doors (t^s) 
windcvs (O) 

storage area for audio equi{incnt (V;:!!) 
«ieats (0 ) 
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ITEM R 



Appalachian Education Satellite Project 
Resource Coordinating Center 
Evaluation Component 
306 Frazec Hall, University o^ Kcntvcky 
Lexington, Kentucky 40506 

CONFIDENTIAL BACKGROUND QUESTIOraAIRJi FOR RHADING (CBQR) 

Instructions 

Fill in the blanks with the appropriate information. Many of the items simply 
require that you check the category that applies to you. Do not mark more 
than one answer to esch question. This information helps the instructor 
shape the course to moet the needs of the students. The information is 
confidential and i n no y:ay at'fects your gyad e in the course* 

Student Number: 



School ; City : ^ State i 

Description of Community: Rural Urban 

Sex: Mclc Fem^ilc Age in years: (as of • last birthday) 

Scores on GRE: Verbal Quantitative Not Taken 

Score on National Tcricher's Exam: Not Taken 

score on ACT: Not Taken 

Positio!. During 1973-7*1: Teacher 

Counselor 

Principal ^ 

Other ' (explain) ^ 



Grade Level 



Position During 1974-75: Same Change 

If changed, title and grade of new position 



Work Experience in Teaching: ^ (in years) 

Experience in Teaching Reading; ^ {in years} 

DPni course TaJcen fort Credit Non-Credit (chcc)c one) 



BEST COrr RVnUBLE 
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^, Undergrddiii^te Grade Point Average on a 4,0 Scale 

a) loss than 1.99 

b) 2.00 - 2.49 

c) 2,50 - 2.90 

d) 3,00 - 3-49 

e) 3.50 - 4.00 

2. Graduate Grade Point Average on a 4.0 Scale 

a) Iccd than 2,06 

b) 2.67 - 2.99 

c) 3.00 - 3.33 

d) 3.34 - 3,66 

e) 3.67 « 4.00 

3. Last Deyrt^c Completed 

a) High School Diplora 

b) Baccalaureate 

c) flastcr*c 

d) Specialist 

e) Doctorate 

Number of Undergraduate Reading Courses Ccmpletcd 



5. 



a) none 


f) 


5 


b) 1 


g) 


6 


c) 2 


h) 


7 


d) 3 


i) 


0 


c) 4 


j) 


9 


Number of 


Graduate 


Re; 


a) none 


f) 


5 


b) 1 


9) 


6 


c) 2 


h) 


7 


d) 3 


i) 


8 


e) 4 


j) 


9 



6. Are You Enrolled in College Program? No Ye« 

7. If Yes, Work in Progre<?s - on 

a) Baccalaureate 

b) Master's 

c) Specialist 

d) Doctorate 

e) Enrolled, Hon-Dogrcc Student 



AESP/EVAL/5/27/74/mt 



ERiC 97 



BEST COnr WffUBtF 

ITEM S 



Appalachian Education Satellite Project 
Resourc<:s Coordinating Center 
Evaluation Component 
306 Frazee Hall, University of Kentucky 
Lexington I Kentucky 40506 



CONFIDENTirX BACK."HOU:^ QUESTIONNAIRE FOR CAREER EDUCATION (CBQCE) 



struct j one 



Fill in the blanks with the appropriate information. Many of the items ai-nply 
require that you check the category that applies to you. Do not mark more 
than one answer to each question* This information helps the instructor 
shape the course to meet the needs of the students. The information is 
confidential and in no way affects your grade in the course. 



Student Number: 



Schools ; City J State: 

Description of Community i Rural Urban 

Sex: Male Female Age in Years; (as of last birthday) 

Scores on GRE: Verbal Ouantitative Not Taken 

Score on National Teacher's Exam: Not Taken 

Score on ACT: Not Taken 

Position During 1973-74: Teacher 

Counselor 

Principal 

Other (explain) ^ 



Grade tievel 



Position During 1D74-75: Same Change _^ 

If changed, title and grade of new position 



»*>rk Experience in Teaching: (in years) 

Experience in Teaching Career Education i (in years) 

Course Taker for: Credit Non-Credit (check one) 



1. Undergraduate Grade Point Average on a «.0 Scale 

.99 



2. 



4. 



a) 


less 


than 1 


b) 


2.00 


- 2.49 


c) 


2.50 


- 2.99 


d) 


3.00 


- 3.49 


e) 


3.50 


- 4.00 


Graduate 


Grade 1 


a) 


less 


than 2 


b) 


2.67 


- 2,99 


c) 


3.00 


- 3.33 


d} 


3.34 


- 3.66 


e) 


3.6? 


- 4.00 



3* Last Degree Completed 

a) High School Diploma 

b) Baccalaureate 

c) f:astcr*s 

d) Specialist 

e) Doctorate 



Number of Undergraduate Career Education Courses Completed 



a) none 


f) 


5 


b) 1 


9) 


5 


c) 2 


h) 


7 


d) 3 


i) 


3 


e) 4 


j) 


9 or more 


Number of 


Graduate 


Career Education 


a) none 


f) 


5 


b) 1 


g) 


6 


c) 2 


h) 


7 


d) 3 


i) 


8 


e) 4 


j) 


9 or more 



6. Are You Enrolled in College Program? No Yes 

7* If Yes, Work in Progress on 

a) fiacca 1 ^ ureate 

b) Master s 

c) Specialist 
A) Doctorate 

e) Enrolled, Non-Degree Student 
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ITEM T 



Appalachian Education Satellite Project 
Resource Coordinating Center 
Evaluation Component 
306 Frazee Hall, Univertily of Kentucky 
Lexington, Kentucky 40506 



SITE MONITOR QUCSTICNNAIRE (SMQ; 



Names ______„„________^ RESA? _ 

Sext Male Female, Site: ^ 

Couriie I 



1, Occupatio nal Inf orwat ion 



a) During the regular school year what is your occupation? Please 
give specific title and location cf employment* 



b) How were you selected to become a site monitor for the AESP 
experiment? 



c) For what course (is) are you to be a site monitor? 



1 



100 



90 



Education 

a) Last Dagreo Coifqpl6t«d (circle appropriato lettar) 

1) High School Diploma 

2) Baccalauroata 

3) Master* 8 

4) Specialist 

5) Doctorata 

b) Work in Progress on (circle appropriate letter) 

1) Baccalaureate 

2) Master's 

3) Specialist 

4) Docturate 

5) Enrolled, non-degree student 

6) Not enrolled 

c) List Areas of Specialisation during formal educational training* 

1) 



2) 
3) 
4) 



Teaching Experience 

a) How many years of teaching experience do you have at the following 
levels? 

1) Elementary ^ 

2) Junior high ___ 

3) High school 

4) College (undergraduate) 

5) College (graduate) 

b> List the subject areas In which you have taught. 

I) 



3) 
3) 
4) 



5) 



Bisj con m\m. 



c) Wow m«ny year© of occupational anrerianca do you hava in othar 
areas of education? 

1) Principal (cleme^ntary) 

2) Principal (junior high) 

3) Principal (high school) 

4) Guidance counselor ^^^^^ 

5) Super in tendant 

6) Research and dcvolopmant 

7) Other (please specify) 



Background In the Reading Area 

(answer only if you are the «ite monitor for the r agnostic and 
Prescriptive Reading Courso). 

a) Number of undergraduate reading courses taken ■ 

b) Number of graduate reading courses ta)ten 

c) Teaching experience in the reading area (in years) 

d) Have you attended any wor)cshops or other special training sessions 

in the reading area? Yes Ho 

If yes, please explain 



e) To what extent are you familiar (prior to the course worJtshop) with 
standardized reading tests? List any you have used. 



B[ST con WMUBU 



f ) To What extent «re you familiar (prior to the courste workshop) with 
Informal classroom reading tests? 



9) To %#hat extent are you familiar (prior to the course workshop) with 
Instructional materials and methods for teaching reading? 



h) List any other relevant experience or training in the arts of 
reading instruction* 



Background in the Career .Kducation Area 

(answer only if you are the site monitor for the Elementary Career 
Education Course) 

a) Number of undergraduate career education courses taken 

b) Number of graduate career education courses taken ^ 

c) If you have taught at any level, have you incorporated career 
education into your curriculum? Please explaiiu If you have 
never taught write simply "No teaching experience**. 



BEST COPY AVAILABLE 



d) Have you attcndod any worknliops 
career education area? Yes 
If yo8| plcane give the name ^ 
dealt with. 



or special training aesfiions in the 
No 

^>he program and e)q>lain what it 



e) 1*0 what extent were you familiar (prior to the courae workshop) 

with the concepts to be presented in the elementary career education 
course? 



f) Do you have any training or experience in the counsollng area? 

Yea No 

If yea* please explain* 



g) Have you helped establish a career educotion program for your school 

system or worked on a career education planning team. Yes No 

If ycB, please explain* 



h) List any other rolovant experience or training in the area of career 
education. 
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ITEM U 



AppalachiM Education Satollite Trojcct 
Koftource Coordinating Center 
Evaluation Component 
306 Fraseo Hall, University of Kantucky 
Lexington^ Kentucky 4050$ 



CONSULTIKG FACULTY BACKGROUND QUESTIOtmAXRE (CTQ) 



RES A I 



Sext Male Feaale ^ Site (a) i 

Courses 

1« Occupational Information 
a) Academic rank 



b) Job title (if different from above) 



c) Hembor of graduate faculty? full associate no 

not applicable 

d) Tenured? ye» „_ no 

e) Name of college or university 

f) Name of department or ^^ffice 

9) In which areas do you teach? 



^ . — r - -: - ■ - _ _ ■_ - 

h) In which areas are your current, or recent, research activities? 



2. Education 

a) Circle degree heldt MA/N8 EdD PhD 

b) Year degree earned 

c) What was your area of specialization during fomal training? 



B(SI con WMUBU 
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J. .Background In the Heading Arqt 

(Answer only if you are a contuXting faculty Mtnber for the Diagnoatlc 
and Prescriptive Reading coursa) 

a) College teaching experience In the reading area (in years) ^ 

b) Publications in the reading area 

J) journal article (number) 

2) books (number) 

3) learning kite, tests, etc* (specify) 



*• Background in the Career Education Area 

(Answer only if you ar<i a consulting faculty member for the Career 
Education course) 

a) Have you taught Career Education concopta in your classes t yea 
no if yes# explain briefly your approach ^ 



b) Publications in the Career Education araa 
X) journal articles (number) 

i) books (number) 

c) Have you heXpad schools to instalX career education yrogramit? 
y^a no if yaa, pXoave explain 



d) Hava you deveXopod any career education packages # Xearning kits, 
etc.. yea ^^^^ no if yea ^ pXeaae explain 
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ITEM V 



AppslAchlan Education SataUitu Projtct 
R»&ourco Coordinating Center 
Evaluation Con^ononx: 
306 Fraftce Hall. University of Kentucky 
I^xinqton* Kentucky 40506 



ATTENDANCE !UECQRD POM 



XNSTliUCTI0N5;t In the place provided below place the 4*digit n\anber of any 
student who was not in class. Remember also to fill in the 
date# your name, and the ntudent numbera of the participants 
who were sent student withdrawal forma, 

MORNIMG* AP7TONO0N* 
Student 4-digit Number Student 4-di9it Nmber 



1 


1 


2 


2 


3 


3 


4 


4 


5 


5 


6 


6 


7 


7 


0 


8 


9 


9 


10 


10 


11 


11 


12 


12 


13 


13 


14 


14 


IS 


15 


16 


16 


17 


17 


18 


18 


19 


19 


20 


20 



Date I 



Pamon taking attendance i 



8tud«nt withdrawal form sent to (ua« 4-:1i9it atudant numbar to Idantlfy studant) t 



1. 4. 

2. 5. 

1. 6. 



*lf a participant is absant both noming and aftarnoon, his itudont ntanbcr must 
appaar in both noming and aftamoon colunns. 

MSP/KVAiye"2-74/gj» 



BEST con RVMUBLE 



ITEM X 



Appalachian Lducation Satellite Project 
Resource Coordinating Center 
Evaluation Component 
306 Frazee Hall* University* of Kentucky 
Lexington, Kentucky 405C6 



READING SEATING OirMT 



INSTRUCTIONS X In each block print the complete name of the participant in the 
seat* Make sure that the £ront of the chart is pointing 
to the front of the room. Make Tnr<5- 15 copios of this chart: 
one to send to the RCC# a socond to post so that the 
teachers can refer to it, and a third to use when you 
silently take roll. 



F»0t4T OF CIASSROOM 



# _ _ 01 


« 02 


• 03 


1 04 


ff 05 


« 06 


# _ _ 07 


« 08 


« 09 


# 10 


# 11 


# 12 


# 13 


# _ _ 14 


# 16 


• 1« 


# 17 


# 18 


« 19 


# 20 
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BEST con WNUBIE »9 



ITEM Y 



Appalachian Education Satell.lte Project 
Resource Coordinating Center 
Evaluation Component 
306 Frasee Htoll, University of Kentucky 
Lexington, Kentucky 40506 



CAJREEH EDUCATION SEATING CHART 



1NSTRUCTI0:j£j In each block print the complete nama of the participant in the 
seat* Kake cure that the front of the chart is pointing 
to the front of the rooia. hlake T rVRvr. copies of this chart: 
one to send to tho ICC^ a second to post so that the 
teachers can refer to it, and a third to use when you 
silently take roll. 



rROKT OF CLA£Si^K 



« __ 01 


# 02 


1 

# 03 


# _ _ 04 


• _ _ 05 


# 06 


« 07 


# _ _ 08 


» 09 


IC 


ir 11 


# _ _ 12 


# 13 


# 14 


# 16 


• 16 


* 17 


t 18 

1 


« 19 


* _ - 20 
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IxO 



This report was produced under a grant from the National 
Institute of Education. Itie views expressed do not necessarily 
reflect those of the National institute of Education or the U.S. 
Department of Health, Education, and Welfare. 



100 

I 



